Confidence-Based Mesh Extraction from 3D Gaussians
This work addresses mesh extraction challenges in 3D reconstruction for computer vision applications, offering an efficient alternative to prior methods that sacrifice speed.
The paper tackled the problem of ambiguous mesh extraction from 3D Gaussian Splatting in scenes with view-dependent effects by introducing a self-supervised confidence framework that balances photometric and geometric supervision, achieving state-of-the-art results for unbounded meshes with high efficiency.
Recently, 3D Gaussian Splatting (3DGS) greatly accelerated mesh extraction from posed images due to its explicit representation and fast software rasterization. While the addition of geometric losses and other priors has improved the accuracy of extracted surfaces, mesh extraction remains difficult in scenes with abundant view-dependent effects. To resolve the resulting ambiguities, prior works rely on multi-view techniques, iterative mesh extraction, or large pre-trained models, sacrificing the inherent efficiency of 3DGS. In this work, we present a simple and efficient alternative by introducing a self-supervised confidence framework to 3DGS: within this framework, learnable confidence values dynamically balance photometric and geometric supervision. Extending our confidence-driven formulation, we introduce losses which penalize per-primitive color and normal variance and demonstrate their benefits to surface extraction. Finally, we complement the above with an improved appearance model, by decoupling the individual terms of the D-SSIM loss. Our final approach delivers state-of-the-art results for unbounded meshes while remaining highly efficient.