3DFIRES: Few Image 3D REconstruction for Scenes with Hidden Surface
This addresses the problem of reconstructing complete 3D scenes from limited views for applications in robotics or AR/VR, though it appears incremental as it builds on existing reconstruction paradigms.
The paper tackles 3D reconstruction from few posed images, including hidden surfaces, achieving results that match single-view methods with one input and surpass existing techniques for sparse-view reconstruction in quantitative and qualitative measures.
This paper introduces 3DFIRES, a novel system for scene-level 3D reconstruction from posed images. Designed to work with as few as one view, 3DFIRES reconstructs the complete geometry of unseen scenes, including hidden surfaces. With multiple view inputs, our method produces full reconstruction within all camera frustums. A key feature of our approach is the fusion of multi-view information at the feature level, enabling the production of coherent and comprehensive 3D reconstruction. We train our system on non-watertight scans from large-scale real scene dataset. We show it matches the efficacy of single-view reconstruction methods with only one input and surpasses existing techniques in both quantitative and qualitative measures for sparse-view 3D reconstruction.