Navigation-GPT: A Robust and Adaptive Framework Utilizing Large Language Models for Navigation Applications
This research addresses safety and efficiency issues in navigation applications by bridging the gap between conventional systems and LLMs, though it is incremental as it builds on existing LLM and prompt engineering techniques.
The paper tackles the problem of poor performance in existing navigation decision support systems for non-predefined scenarios by proposing a dual-core LLM framework that decomposes tasks and generates context-aware recommendations, demonstrating effectiveness in collision avoidance and unstructured scenarios through comparative analysis with SOTA models.
Existing navigation decision support systems often perform poorly when handling non-predefined navigation scenarios. Leveraging the generalization capabilities of large language model (LLM) in handling unknown scenarios, this research proposes a dual-core framework for LLM applications to address this issue. Firstly, through ReAct-based prompt engineering, a larger LLM core decomposes intricate navigation tasks into manageable sub-tasks, which autonomously invoke corresponding external tools to gather relevant information, using this feedback to mitigate the risk of LLM hallucinations. Subsequently, a fine-tuned and compact LLM core, acting like a first-mate is designed to process such information and unstructured external data, then to generates context-aware recommendations, ultimately delivering lookout insights and navigation hints that adhere to the International Regulations for Preventing Collisions at Sea (COLREGs) and other rules. Extensive experiments demonstrate the proposed framework not only excels in traditional ship collision avoidance tasks but also adapts effectively to unstructured, non-predefined, and unpredictable scenarios. A comparative analysis with DeepSeek-R1, GPT-4o and other SOTA models highlights the efficacy and rationality of the proposed framework. This research bridges the gap between conventional navigation systems and LLMs, offering a framework to enhance safety and operational efficiency across diverse navigation applications.