ZeST: an LLM-based Zero-Shot Traversability Navigation for Unknown Environments
This addresses the safety and cost issues in data collection for robotics navigation, offering a scalable solution, though it appears incremental as it builds on existing LLM capabilities.
The paper tackles the problem of predicting terrain traversability for robotics navigation by introducing ZeST, a method that uses Large Language Models for zero-shot traversability mapping without real-world data collection, achieving safer navigation in both indoor and outdoor environments.
The advancement of robotics and autonomous navigation systems hinges on the ability to accurately predict terrain traversability. Traditional methods for generating datasets to train these prediction models often involve putting robots into potentially hazardous environments, posing risks to equipment and safety. To solve this problem, we present ZeST, a novel approach leveraging visual reasoning capabilities of Large Language Models (LLMs) to create a traversability map in real-time without exposing robots to danger. Our approach not only performs zero-shot traversability and mitigates the risks associated with real-world data collection but also accelerates the development of advanced navigation systems, offering a cost-effective and scalable solution. To support our findings, we present navigation results, in both controlled indoor and unstructured outdoor environments. As shown in the experiments, our method provides safer navigation when compared to other state-of-the-art methods, constantly reaching the final goal.