Search papers, labs, and topics across Lattice.
The paper introduces TERMINATOR, an early-exit strategy for Chain-of-Thought (CoT) reasoning in Large Reasoning Models (LRMs) designed to mitigate overthinking. TERMINATOR leverages the predictability of the first arrival of an LRM's final answer to create a dataset of optimal reasoning lengths, which is then used to train a model to predict when to stop the CoT process. Experiments on MATH-500, AIME 2025, HumanEval, and GPQA datasets demonstrate that TERMINATOR achieves 14%-55% reductions in CoT lengths while outperforming existing methods.
Stop wasting compute: TERMINATOR slashes Chain-of-Thought reasoning length by up to 55% by predicting the optimal early exit point.
Large Reasoning Models (LRMs) achieve impressive performance on complex reasoning tasks via Chain-of-Thought (CoT) reasoning, which enables them to generate intermediate thinking tokens before arriving at the final answer. However, LRMs often suffer from significant overthinking, spending excessive compute time even after the answer is generated early on. Prior work has identified the existence of an optimal reasoning length such that truncating reasoning at this point significantly shortens CoT outputs with virtually no change in performance. However, determining optimal CoT lengths for practical datasets is highly non-trivial as they are fully task and model-dependent. In this paper, we precisely address this and design TERMINATOR, an early-exit strategy for LRMs at inference to mitigate overthinking. The central idea underpinning TERMINATOR is that the first arrival of an LRM's final answer is often predictable, and we leverage these first answer positions to create a novel dataset of optimal reasoning lengths to train TERMINATOR. Powered by this approach, TERMINATOR achieves significant reductions in CoT lengths of 14%-55% on average across four challenging practical datasets: MATH-500, AIME 2025, HumanEval, and GPQA, whilst outperforming current state-of-the-art methods.
