Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the latent reasoning strategies utilized by pretrained language models by decomposing their response distributions into structured, strategy-conditioned representations. The authors introduce a novel variational objective that mitigates posterior collapse, enabling the model to effectively route information through latent strategies while maintaining the integrity of the original response distribution. Their approach successfully identifies distinct reasoning strategies aligned with specific tasks, demonstrating that language models can leverage multiple strategies for problem-solving without sacrificing performance.
Language models can uncover distinct reasoning strategies without compromising their original response capabilities, revealing a rich landscape of implicit problem-solving techniques.
A language model $p_\theta(y \mid x)$ trained on reasoning tasks learns to solve problems via multiple distinct strategies, yet these strategies are implicit and entangled within the model's response distribution. We study the problem of decomposing the response distribution of a given pretrained language model into a structured, strategy-conditioned representation. Specifically, we learn a latent-variable factorization $p_\theta(y \mid x) \leadsto (r_\phi(z \mid x), g_\phi(y \mid x,z))$, where a router $r$ maps each input to a distribution over latent strategies $z$ and a generator $g$ produces the response conditioned on that strategy. A key challenge is that the generator, initialized from the base model, already represents $p_\theta(y \mid x)$ without using $z$. Standard variational inference therefore gives the model no incentive to route information through $z$ and can yield a severe form of posterior collapse. To address this, we propose a variational objective that measures fractional information gain relative to the base model's response loss and concentrates reconstruction pressure on tokens with high base model surprisal, encouraging $z$ to encode strategy-relevant response variation. We introduce a benchmark of multi-strategy algorithmic tasks and show that this objective recovers latent codes aligned with distinct reference strategies while preserving the base model's response distribution.