Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Flow-based Latent Reasoning (FLaRe), a novel approach to latent reasoning in LLMs that leverages flow matching in a learned latent space. FLaRe is designed to meet five critical requirements for effective latent thought: usefulness, diversity, explainability, refinability, and efficiency, addressing limitations of prior methods that often learn shortcuts or imitate explicit CoT. The proposed recipe significantly improves upon existing latent reasoning techniques across all five requirements and achieves comparable accuracy to explicit CoT with substantially reduced latency.
Latent reasoning models can achieve 97% of explicit CoT accuracy at 25% of the latency by shaping a continuous latent space with flow matching and self-verification.
Latent reasoning lets a large language model (LLM) think in a continuous space and verbalize only the answer. We argue that an effective latent thought must meet five requirements: it should be useful, helping produce the correct answer rather than merely changing it, diverse, so that resampling yields different reasoning trajectories, explainable, so that a decoded chain of thought (CoT) reflects reasoning the answer actually follows, refinable with more inference compute, and efficient, costing less than an explicit CoT at comparable accuracy. Current methods rarely meet these requirements: they learn shortcuts from the question, distill the explicit CoT into their weights, or imitate it one token at a time. We focus on flow matching in a learned latent space, the family we argue is best placed to meet them, and identify the training choices that make it work. The result is Flow-based Latent Reasoning (FLaRe), a simple recipe covering what the latent space encodes and how to shape it, where to train the flow, how to read out the answer, and a final stage of training on the model's own verified thoughts. A probe for each requirement shows that FLaRe improves on prior latent methods in all five. It also compares favorably with them on arithmetic benchmarks, while reaching 97% of the accuracy of explicit CoT at a quarter of its latency.