Search papers, labs, and topics across Lattice.
This paper introduces Ask-Condition-Abstain Reinforcement Learning (ACA-RL), a novel framework designed to enhance reasoning models' capabilities in scenarios where essential premises are missing from queries. By employing a reasoning-graph-guided approach, ACA-RL generates training instances that reflect these missing-premise situations and incorporates a structured reward system to encourage models to either ask for additional information, condition their responses, or abstain from answering when necessary. The results show that ACA-RL significantly improves performance on the newly created Missing-Premise Benchmark (MPB) while maintaining competitive results on traditional reasoning tasks, highlighting the importance of handling uncertainty in NLP evaluations.
Models trained with ACA-RL not only outperform on missing-premise tasks but also redefine how we evaluate reasoning under uncertainty in NLP.
Answer-only reinforcement learning (RL) trains reasoning models to solve fully specified problems, but many realistic queries omit a premise needed for a unique answer. In this setting, the useful response is not always refusal: the model should ask for the missing premise, condition its answer on the unknown quantity, or abstain when no informative conditional response is available. We present \emph{Ask-Condition-Abstain Reinforcement Learning} (ACA-RL), a data-augmented RL framework for this setting. Its reasoning-graph-guided pipeline converts well-posed problems into missing-premise training instances with localized gap annotations; ACA-RL then trains on these instances with a structured reward over five observable response behaviors. We also introduce the \emph{Missing-Premise Benchmark} (MPB), a 274-instance human-verified benchmark spanning mathematical, logical, and real-world word problems. Across Qwen3 and Llama models, ACA-RL consistently improves on MPB while preserving competitive performance on well-posed reasoning tasks. Together with the released code, MPB, and training data, this work supports a new mission for NLP evaluation: measuring whether models can recognize when a task is underdetermined and handle uncertainty, not only whether they can answer fully specified questions.
