CVAIJun 29

FFAvatar: Feed-Forward 4D Head Avatar Reconstruction from Sparse Portrait Images

arXiv:2606.3034712.3
Predicted impact top 28% in CV · last 90 daysOriginality Incremental advance
AI Analysis

This work addresses the need for efficient, flexible, and high-fidelity 4D head avatar reconstruction from limited input images, benefiting applications in virtual reality and telepresence.

FFAvatar introduces a Transformer-based 3D Gaussian framework for reconstructing high-quality, animatable 4D head avatars from sparse portrait images, supporting incremental refinement and achieving superior identity-consistent rendering across expressions and viewpoints.

We present FFAvatar, a Transformer-based 3D Gaussian framework for fast construction of high-quality and animatable 4D head avatars from one or more reference portrait images. Unlike existing feed-forward approaches that require a fixed number of input views, FFAvatar supports incremental reconstruction, progressively refining the avatar representation as additional reference images become available. At the core of our method is an alternating attention mechanism that disentangles identity appearance from expression and viewpoint variations, enabling the reconstruction of a canonical 3D appearance that remains consistent across poses and facial expressions. To balance visual fidelity and computational efficiency, we introduce a sparse-to-dense learning paradigm. Coarse appearance features are first learned using sparse primitives anchored to the FLAME vertex level and are subsequently densified in the UV domain to capture fine-grained geometric and texture details. We further propose a plug-and-play motion refinement module that enables subject-specific dynamic personalization by modeling residual motion beyond parametric deformation. Extensive experiments demonstrate that FFAvatar efficiently produces high-fidelity and controllable 4D head avatars, achieving superior flexibility, driving efficiency, and identity-consistent rendering across diverse expressions and viewpoints.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes