Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
Hybrid Reasoning Agents (HybridAgents) are introduced to bridge the gap between text-based LLM agents and latent reasoning systems by enabling dynamic, seamless transitions between these modalities within a unified generation process. This architecture, featuring a HybridLink and continuous working memory, preserves tool-integrated capabilities while making internal thoughts inspectable. Post-training algorithms, HybridSFT and HybridRL, further optimize hybrid reasoning, leading to significant performance improvements, reduced token usage, and faster, cheaper inference across diverse benchmarks.
Latent thoughts are now inspectable and tool-integrable, achieving 10.4% better performance with 3x faster inference and 70% fewer tokens than frontier LLM agents.
How can we build an agent that thinks beyond human language, yet still acts through it in the external environment? Modern LLM agents still reason and interact through text, while latent reasoning offers an efficient internal medium but lacks native tool access and reasoning transparency. We bridge these two directions with Hybrid Reasoning Agents (HybridAgents), which dynamically navigate between latent reasoning and text-based interaction throughout a unified generation process. Architecturally, a lightweight HybridLink enables seamless transitions between text and latent modes, while the agent's continuous working memory preserves lossless hybrid context across multiple turns. These designs preserve tool-integrated agentic capabilities while making latent thoughts directly inspectable. Building on this architecture, we further develop dedicated post-training algorithms for hybrid reasoning: HybridSFT stabilizes tool-integrated hybrid generation by teaching the backbone to coordinate with HybridLink, then HybridRL scales reasoning by learning when to think in latent space and when to act through text. We evaluate HybridAgent at 3 model scales across 11 benchmarks covering mathematics, science, medicine, search, and agentic reasoning. Compared with frontier LLM Agents and agentic frameworks spanning both text-based and latent methods, HybridAgent consistently improves performance by 10.4%, while delivering 35.5%-54.7% token reduction, 1.8x-2.6x faster inference, and 2.7x-3.7x cost savings. Code and data are available at https://github.com/togethercomputer/HybridAgent.