Search papers, labs, and topics across Lattice.
This paper introduces SWITCH, a novel switchable latent reasoning framework that utilizes explicit boundary tokens to enhance the optimization of hidden-state recurrence in on-policy reinforcement learning. By employing discrete entry and exit tokens, SWITCH not only aligns with standard RL methods but also facilitates causal analysis of the latent reasoning process. The results demonstrate that SWITCH outperforms previous approaches while revealing critical insights into the learned switching policy and the computational significance of latent steps.
A single pair of boundary tokens transforms hidden-state reasoning into a trainable and interpretable framework, revealing causal insights that were previously obscured.
Latent chain-of-thought compresses reasoning by replacing visible reasoning traces with continuous hidden-state recurrence, but existing formulations are difficult to optimize with standard on-policy reinforcement learning (RL) and hard to interpret causally. Our key insight is that a single pair of explicit boundary tokens can address both issues at once: discrete entry and exit anchors make the latent block compatible with standard on-policy RL, and the same anchors offer a natural foothold for mechanistic analysis. Motivated by this, we propose SWITCH, a switchable latent reasoning framework. The model emitsto enter latent mode andto exit. Because the boundaries are ordinary discrete tokens, the GRPO policy ratio is well-defined at every decision point. The same anchors also expose the latent steps to direct probing and causal intervention. We train the model with a visible-to-latent curriculum and a Switch-GRPO objective that propagates gradients through recurrent latent computation. SWITCH consistently outperforms prior hidden-state-recurrence latent reasoning approaches at similar scale. Mechanistic analysis through the boundary tokens further reveals three findings: (i)is a sharply localised, learned switching policy rather than a stylistic artefact; (ii) the latent step it opens performs problem-specific, causally important computation rather than acting as an inert placeholder; and (iii) that computation is concentrated at a single hidden-state transition on entry. Together, these results show that hidden-state-recurrence latent reasoning is both RL-trainable and open to direct mechanistic analysis, including of how on-policy RL itself improves the model from the inside.
