MacRAG: Compress, Slice, and Scale-up for Multi-Scale Adaptive Context RAG
This work addresses retrieval and context construction issues in RAG systems for complex reasoning tasks, offering an incremental improvement with a novel hierarchical approach.
The paper tackles the problem of imprecise retrieval and incomplete context coverage in retrieval-augmented generation (RAG) systems for multi-hop and large-document tasks by introducing MacRAG, a hierarchical framework that compresses and partitions documents into coarse-to-fine granularities and adaptively merges contexts, resulting in consistent performance improvements over baseline RAG pipelines on datasets like LongBench expansions of HotpotQA, 2WikiMultihopQA, and Musique using models such as Llama-3.1-8B, Gemini-1.5-pro, and GPT-4o.
Long-context large language models (LC LLMs) combined with retrieval-augmented generation (RAG) hold strong potential for complex multi-hop and large-document tasks. However, existing RAG systems often suffer from imprecise retrieval, incomplete context coverage under constrained windows, and fragmented information from suboptimal context construction. We introduce Multi-scale Adaptive Context RAG (MacRAG), a hierarchical RAG framework that compresses and partitions documents into coarse-to-fine granularities, then adaptively merges relevant contexts through real-time chunk- and document-level expansions. By initiating with finest-level retrieval and progressively incorporating broader, higher-level context, MacRAG constructs effective query-specific long contexts, optimizing both precision and coverage. Evaluations on challenging LongBench expansions of HotpotQA, 2WikiMultihopQA, and Musique confirm MacRAG consistently surpasses baseline RAG pipelines in single- and multi-step generation using Llama-3.1-8B, Gemini-1.5-pro, and GPT-4o. Our results establish MacRAG as an efficient, scalable solution for real-world long-context, multi-hop reasoning. Our code is available at https://github.com/Leezekun/MacRAG.