PI-BA Bundle Adjustment Acceleration on Embedded FPGAs with Co-observation Optimization
This addresses the problem of efficient BA for embedded systems in robotics and autonomous driving, though it is incremental as it builds on prior hardware acceleration methods.
The paper tackles the high time and power consumption of bundle adjustment (BA) in applications like 3D reconstruction and autonomous driving by proposing π-BA, a hardware-software co-designed engine on an embedded FPGA-SoC that uses Co-Observation Optimization to accelerate operations, achieving improved performance and power efficiency compared to existing software implementations.
Bundle adjustment (BA) is a fundamental optimization technique used in many crucial applications, including 3D scene reconstruction, robotic localization, camera calibration, autonomous driving, space exploration, street view map generation etc. Essentially, BA is a joint non-linear optimization problem, and one which can consume a significant amount of time and power, especially for large optimization problems. Previous approaches of optimizing BA performance heavily rely on parallel processing or distributed computing, which trade higher power consumption for higher performance. In this paper we propose π-BA, the first hardware-software co-designed BA engine on an embedded FPGA-SoC that exploits custom hardware for higher performance and power efficiency. Specifically, based on our key observation that not all points appear on all images in a BA problem, we designed and implemented a Co-Observation Optimization technique to accelerate BA operations with optimized usage of memory and computation resources. Experimental results confirm that π-BA outperforms the existing software implementations in terms of performance and power consumption.