Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioning
This addresses scaling challenges in RAG systems for applications requiring efficient and accurate retrieval from large knowledge graphs, representing an incremental advancement.
The paper tackles the efficiency-accuracy trade-off in Retrieval-Augmented Generation (RAG) systems for large knowledge graphs by proposing SPLIT-RAG, a multi-agent framework that uses question-driven semantic graph partitioning and collaborative subgraph retrieval, resulting in considerable improvements over existing approaches.
Retrieval-Augmented Generation (RAG) systems empower large language models (LLMs) with external knowledge, yet struggle with efficiency-accuracy trade-offs when scaling to large knowledge graphs. Existing approaches often rely on monolithic graph retrieval, incurring unnecessary latency for simple queries and fragmented reasoning for complex multi-hop questions. To address these challenges, this paper propose SPLIT-RAG, a multi-agent RAG framework that addresses these limitations with question-driven semantic graph partitioning and collaborative subgraph retrieval. The innovative framework first create Semantic Partitioning of Linked Information, then use the Type-Specialized knowledge base to achieve Multi-Agent RAG. The attribute-aware graph segmentation manages to divide knowledge graphs into semantically coherent subgraphs, ensuring subgraphs align with different query types, while lightweight LLM agents are assigned to partitioned subgraphs, and only relevant partitions are activated during retrieval, thus reduce search space while enhancing efficiency. Finally, a hierarchical merging module resolves inconsistencies across subgraph-derived answers through logical verifications. Extensive experimental validation demonstrates considerable improvements compared to existing approaches.