IRisPath: Enhancing Costmap for Off-Road Navigation with Robust IR-RGB Fusion for Improved Day and Night Traversability
This addresses navigation challenges for applications like agriculture and search/rescue in dynamic off-road environments, though it appears incremental as it builds on existing multimodal fusion approaches.
The paper tackles the problem of autonomous off-road navigation under varying weather and light conditions by proposing IRisPath, a multimodal fusion network that combines thermal and RGB images to improve robustness, achieving translation accuracy of +/-1.7cm and rotation accuracy of +/-0.827 degrees for sensor calibration.
Autonomous off-road navigation is required for applications in agriculture, construction, search and rescue and defence. Traditional on-road autonomous methods struggle with dynamic terrains, leading to poor vehicle control in off-road conditions. Recent deep-learning models have used perception sensors along with kinesthetic feedback for navigation on such terrains. However, this approach has out-of-domain uncertainty. Factors like change in time of day and weather impacts the performance of the model. We propose a multi modal fusion network "IRisPath" capable of using Thermal and RGB images to provide robustness against dynamic weather and light conditions. To aid further works in this domain, we also open-source a day-night dataset with Thermal and RGB images along with pseudo-labels for traversability. In order to co-register for fusion model we also develop a novel method for targetless extrinsic calibration of Thermal, LiDAR and RGB cameras with translation accuracy of +/-1.7cm and rotation accuracy of +/-0.827degrees.