Search papers, labs, and topics across Lattice.
CMU MLBUPTInstitute of Foundation ModelsInstitute of Foundation Models (IFM)May 21, 2026arXiv:2605.22138The paper introduces SR^2AM, a novel agentic LLM architecture that decomposes decision-making into reactive execution, simulative reasoning via a world model, and learned self-regulation of planning depth and frequency. By training a "configurator" to decide when and how deeply to plan, SR^2AM achieves performance competitive with much larger models while drastically reducing reasoning token usage across diverse tasks. Experiments show that reinforcement learning further optimizes the planning horizon without significantly increasing planning frequency, indicating effective self-regulation.
Achieve SOTA reasoning performance with a 30B parameter model using up to 95% fewer tokens by explicitly controlling when and how deeply an LLM plans.
How should an agent decide when and how to plan? A dominant approach builds agents as reactive policies with adaptive computation (e.g., chain-of-thought), trained end-to-end expecting planning to emerge implicitly. Without control over the presence, structure, or horizon of planning, these systems dramatically increase reasoning length, yielding inefficient token use without reliable accuracy gains. We argue efficient agentic reasoning benefits from decomposing decision-making into three systems: simulative reasoning (System II) grounding deliberation in future-state prediction via a world model; self-regulation (System III) deciding when and how deeply to plan via a learned configurator; and reactive execution (System I) handling fine-grained action. Simulative reasoning provides unified planning across diverse tasks without per-domain engineering, while self-regulation ensures the planner is invoked only when needed. To test this, we develop SR^2AM (Self-Regulated Simulative Reasoning Agentic LLM), realizing both as distinct stages within an LLM's chain-of-thought, with the LLM as world model. We explore two instantiations: recording decisions from a prompted multi-module system (v0.1) and reconstructing structured plans from traces of pretrained reasoning LLMs (v1.0), trained via supervised then reinforcement learning (RL). Across math, science, tabular analysis, and web information seeking, v0.1-8B and v1.0-30B achieve Pass@1 competitive with 120-355B and 685B-1T parameter systems respectively, while v1.0-30B uses 25.8-95.3% fewer reasoning tokens than comparable agentic LLMs. RL increases average planning horizon by 22.8% while planning frequency grows only 2.0%, showing it learns to plan further ahead rather than more often. More broadly, learned self-regulation instantiates a principle we expect to extend beyond planning to how agents govern their own learning and adaptation.
