Search papers, labs, and topics across Lattice.
The paper introduces Grounded Reasoning via Interactive Reinforcement Learning (GRIL) to address ungrounded reasoning in LLMs, where models fabricate information due to a lack of inferential boundary awareness. GRIL uses a multi-turn reinforcement learning framework that decomposes reasoning into clarification/pausing and grounded reasoning stages, incentivizing the model to identify information gaps and request missing premises. Experiments on GSM8K-Insufficient and MetaMATH-Insufficient demonstrate that GRIL improves premise detection by up to 45%, increases task success by 30%, and reduces response length by over 20%.
LLMs can learn to recognize when they lack sufficient information for reasoning and proactively ask for clarification, leading to more reliable and concise answers.
Large language models have achieved remarkable progress on complex reasoning tasks. However, they often implicitly fabricate information when inputs are incomplete, producing confident but unreliable conclusions -- a failure mode we term ungrounded reasoning. We argue that this issue arises not from insufficient reasoning capability, but from the lack of inferential boundary awareness -- the ability to recognize when the necessary premises for valid inference are missing. To address this issue, we propose Grounded Reasoning via Interactive Reinforcement Learning (GRIL), a multi-turn reinforcement learning framework for grounded reasoning under incomplete information. GRIL decomposes the reasoning process into two stages: clarify and pause, which identifies whether the available information is sufficient, and grounded reasoning, which performs task solving once the necessary premises are established. We design stage-specific rewards to penalize hallucinations, enabling models to detect gaps, stop proactively, and resume reasoning after clarification. Experiments on GSM8K-Insufficient and MetaMATH-Insufficient show that GRIL significantly improves premise detection (up to 45%), leading to a 30% increase in task success while reducing average response length by over 20%. Additional analyses confirm robustness to noisy user responses and generalization to out-of-distribution tasks.
