Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track
This track advances research on trustworthy, context-aware RAG systems for information retrieval and generation, though it is incremental as it builds on a previous edition.
The TREC 2025 RAG Track tackled the challenge of integrating retrieval and generation for complex, real-world information needs by introducing long, multi-sentence narrative queries, resulting in over 150 submissions evaluated for relevance, completeness, attribution, and agreement.
The second edition of the TREC Retrieval Augmented Generation (RAG) Track advances research on systems that integrate retrieval and generation to address complex, real-world information needs. Building on the foundation of the inaugural 2024 track, this year's challenge introduces long, multi-sentence narrative queries to better reflect the deep search task with the growing demand for reasoning-driven responses. Participants are tasked with designing pipelines that combine retrieval and generation while ensuring transparency and factual grounding. The track leverages the MS MARCO V2.1 corpus and employs a multi-layered evaluation framework encompassing relevance assessment, response completeness, attribution verification, and agreement analysis. By emphasizing multi-faceted narratives and attribution-rich answers from over 150 submissions this year, the TREC 2025 RAG Track aims to foster innovation in creating trustworthy, context-aware systems for retrieval augmented generation.