ES-PTAM: Event-based Stereo Parallel Tracking and Mapping
This work addresses the limitations of standard cameras for mobile robots in high-speed and high dynamic range conditions, offering a novel event-based approach that is incremental but provides strong specific gains.
The authors tackled the problem of visual odometry and SLAM in challenging scenarios by proposing an event-based stereo VO system, which achieved significant reductions in trajectory error, such as 45% on RPG, 61% on DSEC, and 21% on TUM-VIE datasets, outperforming state-of-the-art methods.
Visual Odometry (VO) and SLAM are fundamental components for spatial perception in mobile robots. Despite enormous progress in the field, current VO/SLAM systems are limited by their sensors' capability. Event cameras are novel visual sensors that offer advantages to overcome the limitations of standard cameras, enabling robots to expand their operating range to challenging scenarios, such as high-speed motion and high dynamic range illumination. We propose a novel event-based stereo VO system by combining two ideas: a correspondence-free mapping module that estimates depth by maximizing ray density fusion and a tracking module that estimates camera poses by maximizing edge-map alignment. We evaluate the system comprehensively on five real-world datasets, spanning a variety of camera types (manufacturers and spatial resolutions) and scenarios (driving, flying drone, hand-held, egocentric, etc). The quantitative and qualitative results demonstrate that our method outperforms the state of the art in majority of the test sequences by a margin, e.g., trajectory error reduction of 45% on RPG dataset, 61% on DSEC dataset, and 21% on TUM-VIE dataset. To benefit the community and foster research on event-based perception systems, we release the source code and results: https://github.com/tub-rip/ES-PTAM