CVJun 30

Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video

arXiv:2607.0015710.3
Predicted impact top 39% in CV · last 90 daysOriginality Incremental advance
AI Analysis

It addresses the challenge of reconstructing 4D animals from monocular video without relying on strict category-specific priors, enabling generalization across species for computer vision and graphics applications.

The paper presents a progressive test-time optimization framework for high-fidelity 4D animal reconstruction from a single monocular video, achieving superior geometric accuracy, temporal consistency, and visual fidelity across diverse species compared to existing baselines.

Reconstructing 4D animals from monocular videos is challenging due to large inter-species variation, complex articulations, and the lack of reliable templates. Existing approaches typically rely on either strict category-specific priors that restrict generalization, or unconstrained generative models that sacrifice input fidelity. To bridge this gap, we present a progressive test-time optimization framework built on 3D Gaussian Splatting for high-fidelity 4D animal reconstruction from a single video. Our key insight is that a coarse shape prior suffices when coupled with a progressive strategy that disentangles articulated pose from non-rigid deformation. Specifically, we employ a symmetry-aware temporal encoding that exploits bilateral cues while absorbing camera estimation drift and a part-conditioned deformation mechanism guided by learnable part anchors and a learnable skinning field. Extensive experiments demonstrate that our approach generalizes robustly across diverse species, achieving superior geometric accuracy, temporal consistency, and visual fidelity compared to existing baselines, even under severe prior mismatch.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes