Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces Equilibrium Reasoners (EqR), a framework for scalable reasoning that learns task-conditioned attractors in latent dynamical systems, where stable fixed points correspond to valid solutions. EqR scales reasoning depth by increasing iterations and breadth by aggregating stochastic trajectories. Experiments on Sudoku-Extreme show that test-time scaling, by unrolling up to 40,000 layers, dramatically improves accuracy from 2.6% to over 99%, demonstrating the effectiveness of learned attractor landscapes for scalable reasoning.
Unrolling a neural network to the equivalent of 40,000 layers isn't just possible, it's how you get 99% accuracy on Sudoku-Extreme.
Scaling test-time compute by iteratively updating a latent state has emerged as a powerful paradigm for reasoning. Yet the internal mechanisms that enable these iterative models to generalize beyond memorized patterns remain unclear. We hypothesize that generalizable reasoning arises from learning task-conditioned attractors: latent dynamical systems whose stable fixed points correspond to valid solutions. We formalize this process through Equilibrium Reasoners (EqR), which enable test-time scaling without external verifiers or task-specific priors. EqR scales internal dynamics along two axes: depth, by running more iterations, and breadth, by aggregating stochastic trajectories from multiple initializations. Empirically, gains from test-time scaling are tightly coupled with stronger convergence toward solution-aligned attractors. This attractor perspective allows neural networks to adaptively allocate test-time compute based on task difficulty. While simple cases converge within 1 to 5 iteration steps, harder cases benefit from massive test-time scaling. By unrolling up to the equivalent of 40,000 layers, scalable latent reasoning boosts accuracy from 2.6% for feedforward models to over 99% on Sudoku-Extreme. These results suggest that learned attractor landscapes provide a useful mechanistic lens for understanding scalable reasoning in iterative latent models.
CMU ML