Acoustic Neural 3D Reconstruction Under Pose Drift
This addresses a critical bottleneck in underwater or acoustic 3D modeling where pose errors cause artifacts, though it appears incremental as an extension of neural implicit methods.
The paper tackles 3D reconstruction from acoustic images with drifting sensor poses by jointly optimizing neural scene representations and sonar poses through backpropagation, achieving high-fidelity reconstructions on real and simulated datasets.
We consider the problem of optimizing neural implicit surfaces for 3D reconstruction using acoustic images collected with drifting sensor poses. The accuracy of current state-of-the-art 3D acoustic modeling algorithms is highly dependent on accurate pose estimation; small errors in sensor pose can lead to severe reconstruction artifacts. In this paper, we propose an algorithm that jointly optimizes the neural scene representation and sonar poses. Our algorithm does so by parameterizing the 6DoF poses as learnable parameters and backpropagating gradients through the neural renderer and implicit representation. We validated our algorithm on both real and simulated datasets. It produces high-fidelity 3D reconstructions even under significant pose drift.