GradientSurf: Gradient-Domain Neural Surface Reconstruction from RGB Video
This addresses the challenge of detailed surface reconstruction from RGB video for applications like indoor scene modeling, though it is incremental as it builds on Poisson Surface Reconstruction with neural network integration.
The paper tackles the problem of reconstructing detailed surfaces from monocular RGB video in real-time, proposing GradientSurf, which operates in the gradient domain to enhance detail capture. Results show it reconstructs surfaces with more details in curved regions and higher fidelity for small objects compared to previous methods.
This paper proposes GradientSurf, a novel algorithm for real time surface reconstruction from monocular RGB video. Inspired by Poisson Surface Reconstruction, the proposed method builds on the tight coupling between surface, volume, and oriented point cloud and solves the reconstruction problem in gradient-domain. Unlike Poisson Surface Reconstruction which finds an offline solution to the Poisson equation by solving a linear system after the scanning process is finished, our method finds online solutions from partial scans with a neural network incrementally where the Poisson layer is designed to supervise both local and global reconstruction. The main challenge that existing methods suffer from when reconstructing from RGB signal is a lack of details in the reconstructed surface. We hypothesize this is due to the spectral bias of neural networks towards learning low frequency geometric features. To address this issue, the reconstruction problem is cast onto gradient domain, where zeroth-order and first-order energies are minimized. The zeroth-order term penalizes location of the surface. The first-order term penalizes the difference between the gradient of reconstructed implicit function and the vector field formulated from oriented point clouds sampled at adaptive local densities. For the task of indoor scene reconstruction, visual and quantitative experimental results show that the proposed method reconstructs surfaces with more details in curved regions and higher fidelity for small objects than previous methods.