CVGRSep 23, 2024

Human Hair Reconstruction with Strand-Aligned 3D Gaussians

ETH Zurich
arXiv:2409.14778v141 citationsh-index: 42
Originality Highly original
AI Analysis

This work addresses the need for accurate and editable hair models in computer graphics, enabling direct use in rendering and simulation engines.

The paper tackles the problem of reconstructing realistic hair strands from multi-view data by introducing a dual representation combining classical hair strands with 3D Gaussians, achieving state-of-the-art performance in strand-based hair reconstruction.

We introduce a new hair modeling method that uses a dual representation of classical hair strands and 3D Gaussians to produce accurate and realistic strand-based reconstructions from multi-view data. In contrast to recent approaches that leverage unstructured Gaussians to model human avatars, our method reconstructs the hair using 3D polylines, or strands. This fundamental difference allows the use of the resulting hairstyles out-of-the-box in modern computer graphics engines for editing, rendering, and simulation. Our 3D lifting method relies on unstructured Gaussians to generate multi-view ground truth data to supervise the fitting of hair strands. The hairstyle itself is represented in the form of the so-called strand-aligned 3D Gaussians. This representation allows us to combine strand-based hair priors, which are essential for realistic modeling of the inner structure of hairstyles, with the differentiable rendering capabilities of 3D Gaussian Splatting. Our method, named Gaussian Haircut, is evaluated on synthetic and real scenes and demonstrates state-of-the-art performance in the task of strand-based hair reconstruction.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes