Search papers, labs, and topics across Lattice.
This study investigates the phenomenon of spurious chain-of-thought (CoT) termination in large reasoning models (LRMs) when using an end-of-think (EoT) token to signal the transition from reasoning to answering. The authors find that the EoT token does not always effectively halt reasoning, leading to continued reasoning-like generation that complicates the answering phase. By applying Exit-token Attention Biasing (EAB) across multiple LRMs and benchmarks, they demonstrate that enhancing attention to the EoT can significantly reduce spurious CoT termination and shorten the answering phase.
Spurious reasoning persists even after an end-of-think token is injected, complicating the transition to answering in large reasoning models.
Chain-of-thought (CoT) reasoning improves large reasoning models (LRMs) on complex tasks but often produces long, redundant traces. Recent training-free early-exit methods shorten these traces by choosing an intermediate point to stop reasoning. We study one such strategy that injects an end-of-think token (EoT,) at this point to trigger the reasoning-to-answering transition, and find that the injected EoT does not always induce a clean answering phase. Answering-phase generation can continue before the model regenerates another EoT, with the span preceding this regenerated EoT scaling with the reasoning tokens saved by early exit and exhibiting continued reasoning behavior. We call this spurious CoT termination, where reasoning-like generation continues into the answering phase. We hypothesize that insufficient attention to the injected EoT contributes to spurious CoT termination and probe this hypothesis with Exit-token Attention Biasing (EAB). Across four LRMs, five benchmarks, and two early-exit methods, increasing attention to the injected EoT reduces spurious CoT termination and answering-phase length. These results reveal a limitation of controlling LRMs by externally matching their explicit think-block format. Inserting the EoT token conforms to this format but does not by itself guarantee the intended reasoning-to-answering transition. Our code is available at https://github.com/Seunghee-Koh/Spurious-CoT-Termination.
