Search papers, labs, and topics across Lattice.
This study dissects the contributions of metadata, structure, and retrieval strategies in retrieval-augmented generation (RAG) systems through a controlled experiment involving over 24,000 responses across various models and enrichment levels. Contrary to the prevailing assumption that richer context leads to better answers, the findings reveal that most forms of enrichment actually reduce accuracy, highlighting a disconnect between metadata utilization and answer quality. Notably, when metadata and retrieval strategies align with model capabilities, a smaller model can outperform a larger frontier model by 19 F1 points, suggesting a need to prioritize model-context alignment over mere metadata accumulation in RAG design.
Most enrichment strategies in RAG systems backfire, with a smaller model outperforming a larger one by 19 F1 points when metadata aligns with model capabilities.
Retrieval-augmented generation (RAG) systems increasingly enrich retrieved passages by attaching quality metadata, structuring them into explicit records, and adopting multi-hop retrieval strategies that accumulate evidence across steps. These changes assume that richer context yields better answers, yet existing evaluations cannot test this because they vary all three factors at once. We isolate each factor in a controlled experiment across six benchmarks, four models from three families, and five enrichment levels, totaling over 24,000 evaluated responses. The assumption does not hold. Most enrichment reduces accuracy. Models prompted to use confidence scores comply correctly yet produce worse answers, a gap between utilization and accuracy that no prior work has measured. What determines answer quality is not how much metadata the context carries but whether the model can act on it for the given task. When metadata and retrieval strategy are aligned with model capabilities, a smaller model outperforms a frontier model by 19 F1 points. These findings motivate a processability hierarchy that predicts, from pre-training properties alone, which metadata a model can productively use, reframing RAG design as a question of model-context alignment rather than metadata accumulation.
