Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study critically evaluates latent reasoning models (LRMs) by analyzing observable patterns in their latent states, specifically focusing on Coconut and CODI. The authors demonstrate that these patterns, often interpreted as evidence of internal reasoning, also appear in control models lacking the proposed mechanisms, indicating that they do not causally influence behavior. Through causal interventions and geometric analyses, the research reveals that latent-thought utilization is a graded phenomenon, challenging the assumption that observable patterns equate to explanations of model behavior.
Observable patterns in latent reasoning models might mislead researchers into thinking they reveal internal mechanisms, but this study shows they can arise from simpler models too.
Latent reasoning models (LRMs) replace explicit chain-of-thought with continuous thoughts. Recent work treats observable latent-state patterns, such as BFS-like frontiers and decodable arithmetic computation, as evidence for internal reasoning mechanisms. Evaluating two LRMs (Coconut and CODI) against controls lacking the proposed recurrence or curriculum, we find these patterns also appear in the controls and do not always causally affect behavior. Causal interventions reveal that latent-thought utilization is not binary but graded, scaling with a thought's causal effect on model behavior. Geometric analyses reveal this effect concentrates in low-rank directions whose step-to-step geometry grows more structured as their behavioral influence increases. Latent thoughts should therefore be treated as hidden computation, not hidden explanation: decodability, attention, or static structure alone cannot establish mechanism. LRM interpretability thus requires matched controls and causal tests.