Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper identifies a critical issue in retrieval-augmented generation (RAG) known as vector search dilution, where the accuracy of retrieval diminishes as the document collection scales, particularly in heterogeneous datasets. By introducing the Multi-Agent Scoped Domain Retrieval for RAG (MASDR-RAG) approach, the authors demonstrate that incorporating organizational metadata for domain scoping can significantly enhance retrieval performance, achieving a P@10 improvement from 0.77 to 0.86 across various LLMs and datasets. Their findings reveal a precision-faithfulness paradox related to multi-agent orchestration, leading to practical recommendations for optimizing retrieval strategies in RAG systems.
Scaling document collections can drastically reduce retrieval accuracy, but domain scoping with metadata can reverse this trend and boost performance significantly.
Retrieval-augmented generation degrades when scaled to large, heterogeneous document collections, where dense similarity loses discriminative power, and top-k retrieval increasingly returns semantically similar but contextually incorrect chunks. We refer to this failure mode as vector search dilution. Even when using hybrid dense+sparse retrieval, we observed this firsthand in a deployed Wyoming Department of Transportation corpus, where scaling from 54 to 1,128 documents (88,907 chunks) reduced accuracy from 75% to below 40%. To address this dilution, we propose MASDR-RAG ( Multi-Agent Scoped Domain Retrieval for RAG) and evaluate it on 200 expert-validated queries across five LLM backbones, six corpora, and two index stacks. Our results indicate that domain scoping using organizational metadata is the key fix, significantly improving P@10 from 0.77 to 0.86 ($p < 0.05$). Furthermore, our investigation of multi-agent orchestration revealed that a high degree of configuration dependence results --creating what we call the precision-faithfulness paradox. Based on these varied outcomes, our practical recommendation is simple: scope first, then perform a single synthesis call, reserving full multi-agent orchestration for genuinely multi-domain corpora paired with native-tool-call backbones. Code and Data will be made public upon acceptance.