Dual Reasoning: A GNN-LLM Collaborative Framework for Knowledge Graph Question Answering
This work improves KGQA for AI applications by integrating explicit graph learning with LLMs, though it is incremental as it builds on existing dual-process and GNN-LLM methods.
The paper tackles the problem of enhancing Large Language Models (LLMs) for Knowledge Graph Question Answering (KGQA) by addressing hallucination and inefficient reasoning chains, achieving state-of-the-art performance on three benchmark datasets.
Large Language Models (LLMs) excel at intuitive, implicit reasoning. Guiding LLMs to construct thought chains can enhance their deliberate reasoning abilities, but also faces challenges such as hallucination. Knowledge Graphs (KGs) can provide explicit structured knowledge for LLMs to alleviate these issues. However, existing KG-enhanced methods often overlook explicit graph learning, making it challenging to efficiently provide precise reasoning chains for LLMs. Following dual-process theory, we propose Dual-Reasoning (DualR), a novel framework that integrates an external system based on Graph Neural Network (GNN) for explicit reasoning on KGs, complementing the implicit reasoning of LLMs through externalized reasoning chains. DualR designs an LLM-empowered GNN module for explicit learning on KGs, efficiently extracting high-quality reasoning chains. These reasoning chains are then refined to a knowledge-enhanced multiple-choice prompt, guiding a frozen LLM to reason thoughtfully for final answer determination. Extensive experiments on three benchmark KGQA datasets demonstrate that DualR achieves state-of-the-art performance while maintaining high efficiency and interpretability.