Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DoubtLess, a training-free contrastive decoding method that leverages a smaller "brief thinker" model to steer a larger reasoning model towards more concise Chain-of-Thought (CoT) generation. By comparing the outputs of the smaller model prompted for brevity versus verbosity, DoubtLess injects a learned difference into the larger model's logits at each decoding step, effectively penalizing unnecessary tokens. On seven benchmarks, DoubtLess achieves a 31% reduction in CoT length for Qwen3-32B with no accuracy degradation, outperforming existing inference-time baselines and generalizing across model families.
A small, training-free "brief thinker" can cut LLM reasoning tokens by 31% without sacrificing accuracy.
Reasoning models achieve strong performance through long chains of thought (CoT), but often spend more tokens than needed to solve a problem. Existing ways to shorten the CoT require additional training for each model, add a fixed steering vector to the model's hidden states, or use decoding heuristics such as stopping early or banning words like "wait", which can reduce accuracy. We propose DoubtLess, a training-free decoding method in which a much smaller reasoning model steers the large one towards brevity. The small model reads the large model's CoT so far twice, once prompted to be brief (the brief thinker) and once prompted to be verbose (the verbose thinker), and the difference between its two logit vectors, scaled by a strength, is added to the large model's logits at every step of the CoT. On seven benchmarks of competition mathematics, graduate-level science and competitive programming, DoubtLess shortens the CoT of Qwen3-32B by 31% with unchanged accuracy, outperforming five inference-time baselines. We also show that DoubtLess reduces thinking tokens per turn by 20% in a self-debugging coding agent with unchanged task performance. It also generalizes to two other model families with unchanged accuracy. When combined with training-based compression, it further shortens the CoT of a model already trained for brevity. Ablations and behavioral analysis show that DoubtLess reduces repeated checking, with most token savings coming after the correct answer first appears in the CoT. Our code is available at https://github.com/leoluolol/DoubtLess.