Search papers, labs, and topics across Lattice.
This study systematically investigates context interference in multi-turn search agents powered by Large Language Models (LLMs), identifying that the latest retrieved documents are the primary source of interference. To address this issue, the authors introduce a distill-based context refiner that dynamically mitigates context interference, enhancing the reliability and efficiency of search agents. The findings demonstrate that incorporating this context refinement into reinforcement learning training pipelines leads to significant performance improvements, suggesting a new paradigm of "refine context and then generate" for AI agents.
Context interference can significantly degrade the performance of search agents, but a novel context refiner shows how to enhance their reliability and efficiency dramatically.
Recent research empowers Large Language Models (LLMs) as multi-turn search agents to iteratively retrieve and generate outputs until complex tasks are solved. However, the contexts of multi-turn search agents are lengthy and complex. For example, the retrieved set of documents in each turn would inevitably introduce irrelevant information that distracts LLMs, referring to \textit{context interference}, potentially hindering the reliability and efficiency of search agents. Therefore, we conduct a systematic study on context interference in multi-turn search agents, focusing on investigating i) which parts of the context of search agents will contribute to the context interference, ii) how to refine the contexts of search agents to mitigate the interference, and iii) can incorporating context refinement into search agent training yield further improvements. We reveal that interference primarily arises from the latest retrieved documents. Based on the explored findings, we then introduce a distill-based context refiner to dynamically mitigate context interference for multi-turn search agents. Finally, we validate that incorporating context refinement into RL training pipelines of search agents can significantly enhance both reliability and efficiency. This study highlights the importance of mitigating context interference of search agents, inspiring a novel paradigm of ``refine context and then generate'' for AI agents.
