Search papers, labs, and topics across Lattice.
This paper introduces DynaKRAG, a novel framework that learns to control evidence acquisition in multi-hop retrieval-augmented generation by dynamically selecting from a set of evidence operations based on the current state. The approach leverages a validity layer to construct executable actions and a learned controller to optimize the selection process, significantly improving performance on benchmarks like HotpotQA and 2Wiki. Key results show that DynaKRAG outperforms existing methods, highlighting the importance of coordinated retrieval and diagnosis in enhancing evidence acquisition efficiency.
Coordinated evidence acquisition in multi-hop RAG can boost performance by nearly 6 F1 points, revealing the critical role of learned control in retrieval processes.
Multi-hop retrieval-augmented generation (RAG) acquires evidence sequentially, with each new document potentially revealing missing facts, bridge entities, query defects, or sufficient support for answering. Existing methods provide useful operations such as iterative retrieval, query reformulation, evidence critique, and sufficiency judging, but typically organize them within method-specific pipelines or predefined control topologies. This leaves underexplored how to learn a shared state-conditioned policy that chooses among currently valid evidence operations. We introduce DynaKRAG, which formulates multi-hop evidence acquisition as state-conditioned control over atomic evidence operations. At each step, a validity layer constructs the executable action set, and a learned controller selects the next operation. The resulting transition updates the evidence state and may enable new operations at subsequent steps. With Qwen2.5-7B-Instruct, DynaKRAG achieves F1 scores of 0.5998 on HotpotQA, 0.5340 on 2Wiki, and 0.3061 on MuSiQue, outperforming the strongest controlled baseline on all three benchmarks. Replacing the learned controller with a uniform-valid policy reduces F1 by 3.96--5.78 points, while removing sufficiency feedback hurts all three datasets. Controlled retrieval-cap experiments further show that additional retrieval is not uniformly beneficial. Together, these results demonstrate the benefit of coordinating retrieval, diagnosis, and gap-directed acquisition under an evolving evidence state.
