CVDec 4, 2024

PlanarSplatting: Accurate Planar Surface Reconstruction in 3 Minutes

arXiv:2412.03451v113 citationsh-index: 7CVPR
Originality Incremental advance
AI Analysis

It addresses the need for efficient planar surface reconstruction in indoor scenes, offering a novel method that eliminates dependencies on plane detection and matching, though it is incremental in improving speed and accuracy.

This paper tackles the problem of fast and accurate surface reconstruction from multiview indoor images by using 3D planes as primitives, achieving reconstruction in 3 minutes with significantly better geometric accuracy on datasets like ScanNet and ScanNet++.

This paper presents PlanarSplatting, an ultra-fast and accurate surface reconstruction approach for multiview indoor images. We take the 3D planes as the main objective due to their compactness and structural expressiveness in indoor scenes, and develop an explicit optimization framework that learns to fit the expected surface of indoor scenes by splatting the 3D planes into 2.5D depth and normal maps. As our PlanarSplatting operates directly on the 3D plane primitives, it eliminates the dependencies on 2D/3D plane detection and plane matching and tracking for planar surface reconstruction. Furthermore, the essential merits of plane-based representation plus CUDA-based implementation of planar splatting functions, PlanarSplatting reconstructs an indoor scene in 3 minutes while having significantly better geometric accuracy. Thanks to our ultra-fast reconstruction speed, the largest quantitative evaluation on the ScanNet and ScanNet++ datasets over hundreds of scenes clearly demonstrated the advantages of our method. We believe that our accurate and ultrafast planar surface reconstruction method will be applied in the structured data curation for surface reconstruction in the future. The code of our CUDA implementation will be publicly available. Project page: https://icetttb.github.io/PlanarSplatting/

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes