Search papers, labs, and topics across Lattice.
The TREC 2025 RAG Track builds upon the 2024 edition by introducing long, multi-sentence narrative queries to simulate complex information needs and reasoning-driven responses. Participants developed retrieval-augmented generation pipelines using the MS MARCO V2.1 corpus, focusing on transparency and factual grounding. The track employed a multi-layered evaluation framework assessing relevance, completeness, attribution, and agreement across over 150 submissions, advancing research in trustworthy, context-aware RAG systems.
Can RAG systems handle complex, multi-sentence queries while maintaining factual grounding and transparency?
The second edition of the TREC Retrieval Augmented Generation (RAG) Track advances research on systems that integrate retrieval and generation to address complex, real-world information needs. Building on the foundation of the inaugural 2024 track, this year's challenge introduces long, multi-sentence narrative queries to better reflect the deep search task with the growing demand for reasoning-driven responses. Participants are tasked with designing pipelines that combine retrieval and generation while ensuring transparency and factual grounding. The track leverages the MS MARCO V2.1 corpus and employs a multi-layered evaluation framework encompassing relevance assessment, response completeness, attribution verification, and agreement analysis. By emphasizing multi-faceted narratives and attribution-rich answers from over 150 submissions this year, the TREC 2025 RAG Track aims to foster innovation in creating trustworthy, context-aware systems for retrieval augmented generation.
