Search papers, labs, and topics across Lattice.
This paper introduces Abstention-Aware Reinforcement Learning (AWA-RL) to mitigate hallucinations in search agents by penalizing fabricated answers when retrieval fails. The authors highlight a critical flaw in existing training paradigms that reward correct responses without addressing inaccuracies, which can lead to increased hallucinations. AWA-RL significantly improves precision by up to 10.3% and enhances the capability-reliability trade-off as measured by the new RA-F1 metric, while maintaining raw accuracy levels.
AWA-RL boosts precision in search agents by up to 10.3% by penalizing hallucinations, challenging the status quo of LLM training.
Recent advances in equipping Large Language Models (LLMs) with search tools and outcome-reward reinforcement learning (RL) have achieved new state-of-the-art results on open-domain QA tasks. However, we argue that current training paradigms harbor a critical vulnerability: they predominantly reward correct answers but fail to penalize fabricated ones when retrieval fails, thereby implicitly exacerbating hallucinations. To address this, we propose Abstention-Aware Reinforcement Learning (AWA-RL), which dynamically shapes the abstention reward utilizing the model's query-specific prior capabilities and continuous on-policy training observations. We also introduce a novel metric, RA-F1, to measure the capability-reliability trade-off. Compared to non-abstaining baselines, AWA-RL boosts absolute precision by up to 10.3% and overall RA-F1 by 2.9%, with only marginal sacrifice in raw accuracy. These results confirm that AWA-RL successfully yields highly capable and reliable search agents. The code, data, and model weights are publicly available at https://github.com/zfj1998/AWA-RL.
DAMO