Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DAC (Divide and Cooperate), a role-decomposed multi-agent training framework that separates evidence acquisition and answer generation into distinct cooperative agents. By employing role-specific learning signals, the framework addresses the credit assignment problem inherent in traditional single-policy models, allowing for more efficient exploration and improved performance in knowledge-intensive question answering tasks. Experimental results demonstrate that DAC outperforms prior approaches, achieving significant gains on general and multi-hop QA benchmarks while utilizing parameter-efficient LoRA modules over a shared backbone.
Separating evidence acquisition from answer generation allows agents to specialize, leading to improved performance and efficient exploration in multi-step reasoning tasks.
Modern language agents which perform multi-step reasoning have shown strong performance in knowledge-intensive question answering. However, existing approaches typically couple evidence acquisition and answer generation within a single policy. This forces a single model to play multiple potentially conflicting roles, inducing a combinatorial explosion in the policy space and hindering efficient exploration. It also introduces a credit assignment problem during training: a search action that retrieves sufficient evidence may still be penalized when generation fails, and vice versa. We propose DAC (Divide and Cooperate), a role-decomposed multi-agent training framework that divides agentic search into two cooperative subtasks, each handled by a dedicated agent trained with role-specific learning signals. The generator serves a dual role as both an answer producer and an evidence sufficiency verifier, abstaining when retrieved evidence is insufficient. This abstention signal is incorporated into the search agent's reward, providing structured cross-agent learning signals that improve credit assignment. Conversely, the searcher exposes the generator to diverse and challenging evidence environments by hard-positive evidence augmentation, improving its robustness. Experiments on general and multi-hop QA benchmarks show that DAC, implemented via parameter-efficient LoRA modules over a shared backbone, achieves strong performance against prior baselines that rely on full fine-tuning of monolithic models.