Towards Versatile Opti-Acoustic Sensor Fusion and Volumetric Mapping
This work addresses the challenge of safe navigation for autonomous underwater vehicles in obstacle-rich environments with varying visibility, representing an incremental improvement in sensor fusion methods.
The paper tackles the problem of accurate 3D volumetric mapping for autonomous underwater vehicles by fusing stereo sonar and a monocular camera to overcome limitations of vision in turbid conditions and sonar's low resolution and elevation ambiguity, resulting in a framework that effectively captures complex geometries and preserves critical information for navigation in varying visibility conditions, as demonstrated in field tests.
Accurate 3D volumetric mapping is critical for autonomous underwater vehicles operating in obstacle-rich environments. Vision-based perception provides high-resolution data but fails in turbid conditions, while sonar is robust to lighting and turbidity but suffers from low resolution and elevation ambiguity. This paper presents a volumetric mapping framework that fuses a stereo sonar pair with a monocular camera to enable safe navigation under varying visibility conditions. Overlapping sonar fields of view resolve elevation ambiguity, producing fully defined 3D point clouds at each time step. The framework identifies regions of interest in camera images, associates them with corresponding sonar returns, and combines sonar range with camera-derived elevation cues to generate additional 3D points. Each 3D point is assigned a confidence value reflecting its reliability. These confidence-weighted points are fused using a Gaussian Process Volumetric Mapping framework that prioritizes the most reliable measurements. Experimental comparisons with other opti-acoustic and sonar-based approaches, along with field tests in a marina environment, demonstrate the method's effectiveness in capturing complex geometries and preserving critical information for robot navigation in both clear and turbid conditions. Our code is open-source to support community adoption.