FacialFilmroll: High-resolution multi-shot video editing
This is an incremental improvement for video post-production professionals, focusing on domain-specific face editing in videos.
The paper tackles the problem of editing faces in high-resolution videos with spatial and temporal consistency, building on existing unwrap mosaic techniques by specializing them to faces and using 3D face models to improve quality and enable automatic edit transfer across shots.
We present FacialFilmroll, a solution for spatially and temporally consistent editing of faces in one or multiple shots. We build upon unwrap mosaic [Rav-Acha et al. 2008] by specializing it to faces. We leverage recent techniques to fit a 3D face model on monocular videos to (i) improve the quality of the mosaic for edition and (ii) permit the automatic transfer of edits from one shot to other shots of the same actor. We explain how FacialFilmroll is integrated in post-production facility. Finally, we present video editing results using FacialFilmroll on high resolution videos.