Search papers, labs, and topics across Lattice.
This paper introduces Uncertainty-aware Multi-Granularity RAG (UMG-RAG), a novel retrieval framework that optimizes the balance between context preservation and relevance in long-document retrieval augmented generation (RAG). By leveraging existing dense and sparse retrievers as complementary experts, UMG-RAG estimates the reliability of retrieved chunks based on query-specific evidence distributions, enhancing the quality of generated answers. Experimental results demonstrate significant improvements in generation quality on question answering benchmarks, validating the effectiveness of uncertainty-aware fusion and parent promotion techniques.
Uncertainty-aware retrieval can significantly enhance answer quality in long-document RAG by intelligently fusing evidence from multiple granularities.
Retrieval augmented generation (RAG) depends critically on the quality and granularity of retrieved evidence. Large retrieval units preserve context but often introduce irrelevant content, which can dilute answer bearing evidence and worsen long context utilization. Fine-grained units are more compact, but they may be difficult to retrieve reliably because short chunks can lack semantic, lexical, or bridging cues needed to match the query. We propose Uncertainty-aware Multi-Granularity RAG (UMG-RAG), a training-free hybrid retrieval framework that treats chunk granularity as query-specific reliability estimation. Instead of training a new retriever or modifying the generator, UMG-RAG uses existing dense and sparse retrievers as complementary experts across multiple chunk granularities. For each query, it converts each expert-granularity score list into an evidence distribution, estimates reliability from distribution entropy, and fuses candidates according to query-specific semantic, lexical, and granularity confidence. We further introduce UMGP-RAG, a parent promotion variant that uses fine-grained hits to locate relevant evidence while returning broader non-redundant parent chunks for local coherence. Experiments on question answering benchmarks show that uncertainty-aware fusion and parent promotion improve generation quality while maintaining a lightweight, plug-and-play retrieval pipeline.
