Progressive Pose-Guided 4D Animal Reconstruction from Monocular Video
It addresses the challenge of reconstructing 4D animals from monocular video without relying on strict category-specific priors, enabling generalization across species for computer vision and graphics applications.
The paper presents a progressive test-time optimization framework for high-fidelity 4D animal reconstruction from a single monocular video, achieving superior geometric accuracy, temporal consistency, and visual fidelity across diverse species compared to existing baselines.
Reconstructing 4D animals from monocular videos is challenging due to large inter-species variation, complex articulations, and the lack of reliable templates. Existing approaches typically rely on either strict category-specific priors that restrict generalization, or unconstrained generative models that sacrifice input fidelity. To bridge this gap, we present a progressive test-time optimization framework built on 3D Gaussian Splatting for high-fidelity 4D animal reconstruction from a single video. Our key insight is that a coarse shape prior suffices when coupled with a progressive strategy that disentangles articulated pose from non-rigid deformation. Specifically, we employ a symmetry-aware temporal encoding that exploits bilateral cues while absorbing camera estimation drift and a part-conditioned deformation mechanism guided by learnable part anchors and a learnable skinning field. Extensive experiments demonstrate that our approach generalizes robustly across diverse species, achieving superior geometric accuracy, temporal consistency, and visual fidelity compared to existing baselines, even under severe prior mismatch.