Turning an Urban Scene Video into a Cinemagraph
This addresses the challenge of creating visually appealing endless animations from uncontrolled real-world videos, which is incremental as it automates a previously manual or constrained process.
The paper tackles the problem of automatically generating high-quality Cinemagraph animations from regular urban scene videos with moving cameras and objects, achieving this by warping videos to a reference viewpoint and detecting regions with static geometry and dynamic appearance.
This paper proposes an algorithm that turns a regular video capturing urban scenes into a high-quality endless animation, known as a Cinemagraph. The creation of a Cinemagraph usually requires a static camera in a carefully configured scene. The task becomes challenging for a regular video with a moving camera and objects. Our approach first warps an input video into the viewpoint of a reference camera. Based on the warped video, we propose effective temporal analysis algorithms to detect regions with static geometry and dynamic appearance, where geometric modeling is reliable and visually attractive animations can be created. Lastly, the algorithm applies a sequence of video processing techniques to produce a Cinemagraph movie. We have tested the proposed approach on numerous challenging real scenes. To our knowledge, this work is the first to automatically generate Cinemagraph animations from regular movies in the wild.