Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper reviews the emerging field of text world models (TWMs) for large language model (LLM)-based agents, which enhance agent capabilities in interactive textual environments by providing a structured understanding of state transitions. By systematically organizing TWMs around a formal framework and the agent lifecycle, the authors delineate foundational concepts, construction methods, applications in training and inference, and evaluation strategies. The key finding is that TWMs can significantly improve agent planning and learning efficiency, addressing the limitations of reactive behavior in current LLM-based agents.
Text world models can transform LLM-based agents from reactive responders into proactive planners, enhancing their performance in complex interactive tasks.
Large language model (LLM)-based agents are increasingly used in interactive textual environments, from web navigation and code editing to tool use and long-horizon dialogue. Yet many remain largely reactive, mapping observations to actions without an explicit model of how these environments are structured and evolve. This motivates text world models (TWMs): transition models over textual states that, given a state and a candidate action, predict the resulting webpage, terminal output, API response, or user reply, thereby supporting planning, efficient learning, and principled evaluation. We systematically review text world models for LLM-based agents, organized around a formal framework and the agent lifecycle: (1) Foundations, defining text world models and characterizing them by state representation and grounding domain; (2) Construction, taxonomizing LLM-as-WM and code-as-WM paradigms and reviewing methods for building them; (3) Application, examining how world models support agents at training time through experience synthesis and at inference time through planning, verification, and adaptation; and (4) Evaluation, covering both evaluation of the world model itself and its use as an evaluation environment for agents. We aim to consolidate this rapidly developing area, clarify its design space, and highlight open challenges for future research.
Tsinghua AI