CVJun 15

SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cues

arXiv:2606.1731014.8
Predicted impact top 27% in CV · last 90 daysOriginality Incremental advance
AI Analysis

For content creators and visual effects artists, this method improves video retaking under large viewpoint changes, addressing a key limitation of existing geometry-guided approaches.

SierpinskiCam enables video retaking from a single monocular video by augmenting geometry-based guidance with Sierpinski dome texture cues, achieving significant gains in camera controllability, geometric consistency, and video quality across diverse scenarios.

Generating novel renderings of a scene along user-defined camera trajectories from a single monocular video, dubbed video retaking, is a compelling but difficult problem in content creation and visual effects. Existing geometry-guided approaches reconstruct a 4D representation from the source video and render it along the target trajectory to condition video diffusion models. However, this guidance degrades as the target camera departs from the source trajectory, leaving newly revealed regions sparse or entirely missing. We propose SierpinskiCam, which addresses this limitation by augmenting geometry-based guidance with Sierpinski dome texture cues that contains rich trackable features even under large viewpoint changes. We further introduce a reference video conditioning mechanism that appends source-video tokens to the target-token sequence and separates the two streams with negative RoPE indices, enabling appearance grounding without architectural modification or per-video adaptation. Extensive experiments show that SierpinskiCam achieves significant gains in camera controllability, geometric consistency, and video quality across diverse and challenging retaking scenarios. Project page: https://hyelinnam.github.io/SierpinskiCam/.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes