Search papers, labs, and topics across Lattice.
This paper addresses two critical bottlenecks in Retrieval-Augmented Generation (RAG): ineffective measurement of evidence utilization and inefficient context budget allocation. The authors introduce a causal leave-one-out probe to accurately measure generative reliance and reveal that traditional context widening strategies lead to relevance decay, advocating for an iterative allocation approach instead. By implementing a closed-loop submodular scheduler that integrates fresh evidence, they achieve significant portfolio recall improvements of 16.7–20.5 absolute percentage points, demonstrating the superiority of feedback-driven orchestration in generative search.
Traditional relevance proxies fail on hard negatives, but a new causal measurement approach reveals how to allocate context for up to 20.5% better recall in generative search.
As Retrieval-Augmented Generation (RAG) shifts toward diverse portfolio generation, it is stymied by two critical bottlenecks: flawed measurement of evidence utilization, and suboptimal context budget allocation. We resolve both sequentially. To resolve measurement, we expose a pervasive ``diagnostic illusion'': standard relevance proxies fail catastrophically on hard negatives. We replace them with an efficient causal leave-one-out probe that accurately isolates generative reliance and formally calibrates the structural dilution of LLM attention. To resolve allocation, we deploy this causal probe in a deconfounded factorial grid. We prove that the prevailing strategy of monolithic context widening is an architectural trap penalized by relevance decay. Instead, allocating compute iteratively across multiple sequential generations drives transformative portfolio recall gains of 16.7--20.5 absolute percentage points, scaling robustly up to 32B models. Finally, we unify these solutions into a deployable closed-loop submodular scheduler. Augmented by an attribution-steered contrastive decoder to override LLM attention inertia, our architecture systematically forces fresh evidence integration. By dominating classical open-loop baselines, we establish sequential, feedback-driven orchestration as the definitive paradigm for generative search. Our code, data, and causal measurement instruments are available at https://github.com/PeiYangLiu/ascp.
