Search papers, labs, and topics across Lattice.
This paper introduces BOUND, a corrective preference distillation framework designed to mitigate persistent search drift in large language model-based deep search agents. By constructing teacher-side search-state briefs that summarize key constraints and evidence, BOUND effectively distinguishes between task-aligned continuations and locally plausible but misleading ones. The method outperforms existing techniques, achieving significant improvements on multiple multi-hop QA and deep-search benchmarks, including a 5.6 EM point gain on Bamboogle and a 4.8 accuracy point gain on BrowseComp-Plus.
BOUND achieves up to 5.6 EM points improvement over traditional methods by correcting local search-control errors in real-time.
Large language model (LLM)-based deep search agents solve tasks through iterative retrieval and reasoning, but locally relevant evidence can cause persistent wrong-anchor drift, constraint drift, or local-topic drift. Existing methods supervise trajectories, outcomes, or steps, but rarely distinguish task-aligned continuations from locally plausible ones that reinforce drift. We propose BOUND, a brief-guided corrective preference distillation framework for persistent search drift. For each student-induced decision-time state, BOUND constructs a teacher-side search-state brief that preserves the original search target and key constraints while summarizing confirmed evidence, missing information, and drift status. Guided by the brief, the teacher determines whether the student's continuation contains a correctable local search-control error likely to affect subsequent decisions. Together with the rollout outcome, this assessment determines whether to construct a corrective contrast between a student-specific correction and the original continuation, or a termination contrast between a supported answer and an unnecessary retrieval continuation. Each validated state-matched preference pair operationalizes a search-control boundary. Direct preference optimization (DPO) distills these preferences into the student, while the brief and teacher-side computation remain confined to training. We evaluate BOUND on four multi-hop QA benchmarks and three deep-search benchmarks. Across the six benchmarks for which we reran baselines, BOUND leads on five datasets and 12 of 14 metrics. Under the same search-control interface and matched settings, BOUND outperforms Trajectory SFT by 5.6 EM points on Bamboogle and 4.8 accuracy points on BrowseComp-Plus. Code is available at https://github.com/RUCAIBox/BOUND.
DAMO