Search papers, labs, and topics across Lattice.
Tsinghua AICUHKEdinburghHKUPKUShanghai University of Finance and EconomicsSUSTechUniversityUniversity of Science and TechnologyJun 8, 2026arXiv:2606.09032This paper reviews the emerging field of text world models (TWMs) for large language model (LLM)-based agents, which enhance agent capabilities in interactive textual environments by providing a structured understanding of how these environments evolve. By categorizing TWMs across foundational concepts, construction methods, applications, and evaluation strategies, the authors clarify the design space and highlight the potential for improved planning and learning in LLM agents. The findings underscore the importance of TWMs in enabling proactive, rather than merely reactive, agent behaviors, thereby advancing the effectiveness of LLM applications in complex tasks.
Text world models can transform LLM-based agents from reactive responders to proactive planners, fundamentally changing how they interact with complex environments.
Large language model (LLM)-based agents are increasingly used in interactive textual environments, from web navigation and code editing to tool use and long-horizon dialogue. Yet many remain largely reactive, mapping observations to actions without an explicit model of how these environments are structured and evolve. This motivates text world models (TWMs): transition models over textual states that, given a state and a candidate action, predict the resulting webpage, terminal output, API response, or user reply, thereby supporting planning, efficient learning, and principled evaluation. We systematically review text world models for LLM-based agents, organized around a formal framework and the agent lifecycle: (1) Foundations, defining text world models and characterizing them by state representation and grounding domain; (2) Construction, taxonomizing LLM-as-WM and code-as-WM paradigms and reviewing methods for building them; (3) Application, examining how world models support agents at training time through experience synthesis and at inference time through planning, verification, and adaptation; and (4) Evaluation, covering both evaluation of the world model itself and its use as an evaluation environment for agents. We aim to consolidate this rapidly developing area, clarify its design space, and highlight open challenges for future research.
