Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces a novel inference-time sampling method, Marginal Sharpening, that directly sharpens the distribution over final answers rather than full reasoning traces. By focusing on the answer marginal, the method aims to improve reasoning by favoring answers supported by multiple plausible reasoning paths. The authors demonstrate that Marginal Sharpening, implemented via a parallel sampling algorithm, outperforms standard power sampling on math and coding benchmarks while being significantly faster.
Forget sharpening the whole chain of thought – focusing on the final answer is all you need to boost LLM reasoning and speed up inference by orders of magnitude.
Inference-time sampling can elicit strong reasoning abilities from language models without additional training. Existing power-sampling methods do so by sharpening the distribution over full generated outputs, favoring completions that are individually likely under the model. We argue that this is the wrong object to target for reasoning: a completion entangles a reasoning trace with a final answer, whereas what matters is whether an answer is supported by many plausible reasoning paths. We therefore shift the target from the full-output distribution to the sharpened answer marginal, making self-consistency an inference-time objective rather than a post-hoc voting criterion. Surprisingly, this marginal target admits an efficient approximation: we propose a simple, purely autoregressive parallel sampling algorithm that approximately samples from the sharpened answer marginal, eliciting stronger performance than standard power sampling on mathematics and coding benchmarks while being orders of magnitude faster.