INGeo: Accelerating Instant Neural Scene Reconstruction with Noisy Geometry Priors
This work addresses the need for instant reconstruction on mobile and AR/VR devices, though it is incremental as it builds on existing optimized methods.
The paper tackles the problem of accelerating 3D scene reconstruction for edge devices by leveraging noisy geometry priors, achieving a 50% reduction in training iterations while maintaining a PSNR over 30 on the NeRF Synthetic dataset.
We present a method that accelerates reconstruction of 3D scenes and objects, aiming to enable instant reconstruction on edge devices such as mobile phones and AR/VR headsets. While recent works have accelerated scene reconstruction training to minute/second-level on high-end GPUs, there is still a large gap to the goal of instant training on edge devices which is yet highly desired in many emerging applications such as immersive AR/VR. To this end, this work aims to further accelerate training by leveraging geometry priors of the target scene. Our method proposes strategies to alleviate the noise of the imperfect geometry priors to accelerate the training speed on top of the highly optimized Instant-NGP. On the NeRF Synthetic dataset, our work uses half of the training iterations to reach an average test PSNR of >30.