Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
To eliminate the token overhead of overthinking without inducing underthinking through crude length truncation, this work identifies that efficient reasoning states occupy a distinct, compact cluster in the latent space of Large Reasoning Models. The authors develop a training-free inference framework that uses quadratic programming to dynamically project deviating hidden states back into this efficient reasoning region. Across four models (1.5B–14B) and six benchmarks spanning math, code, and science, the approach cuts token generation costs by 11.8% to 52.8% while improving accuracy by up to 12.1%.
Large reasoning models don't need longer chains of thought to perform better—projecting drifting hidden states back into an efficient latent cluster cuts token generation by up to 53% while boosting task accuracy by up to 12.1%.
Large Reasoning Models (LRMs) have shown remarkable reasoning capabilities, yet they still suffer from overthinking, generating redundant reasoning steps which incur substantial token consumption. Existing methods, such as suppressing reflective keywords or forcing shorter reasoning lengths, attempt to mitigate this issue but inevitably truncate necessary steps and induce underthinking, thereby compromising performance. To address this dilemma, we investigate the latent representations and observe that efficient reasoning steps naturally cluster into a concentrated region in latent space, while those deviating from this region tend to produce verbose sequences. To leverage this, we keep reasoning focused within this region via a quadratic program which projects deviating hidden states back into the region. Then we propose a novel training-free framework to achieve efficient reasoning that reduces token generation costs without sacrificing performance. Extensive experiments conducted on four models ranging from 1.5B to 14B, and across six benchmarks in math reasoning, coding, and scientific QA, validate the effectiveness of our method, up to a 12.1\% improvement in accuracy while reducing generated tokens by 11.8\% to 52.8\%. Codes are available at \href{https://github.com/hzn18/Opt4Reasoning}{https://github.com/hzn18/Opt4Reasoning}.
Tsinghua AI