Reconstructing Topology-Consistent Face Mesh by Volume Rendering from Multi-View Images
This addresses the need for automated, high-quality 3D face asset creation in industrial production, though it appears incremental as it builds on existing NeRF and mesh-based techniques.
The paper tackles the problem of reconstructing topology-consistent face meshes from multi-view images, which typically requires manual effort or specific settings, by introducing a method that combines explicit mesh with neural volume rendering to optimize geometry while preserving topology, achieving superior reconstruction quality compared to previous approaches.
Industrial 3D face assets creation typically reconstructs topology-consistent face meshes from multi-view images for downstream production. However, high-quality reconstruction usually requires manual processing or specific capture settings. Recently NeRF has shown great advantages in 3D reconstruction, by representing scenes as density and radiance fields and utilizing neural volume rendering for novel view synthesis. Inspired by this, we introduce a novel method which combines explicit mesh with neural volume rendering to optimize geometry of an artist-made template face mesh from multi-view images while keeping the topology unchanged. Our method derives density fields from meshes using distance fields as an intermediary and encodes radiance field in compact tri-planes. To improve convergence, several adaptions tailored for meshes are introduced to the volume rendering. Experiments demonstrate that our method achieves superior reconstruction quality compared to previous approaches, validating the feasibility of integrating mesh and neural volume rendering.