Search papers, labs, and topics across Lattice.
This paper introduces WorldEvolver, a self-evolving world model framework designed to enhance long-horizon LLM agents' foresight by revising context at deployment time while keeping the agent and model parameters fixed. The framework comprises three key modules: Episodic Memory for real action transition simulations, Semantic Memory for extracting heuristic rules from prediction mismatches, and Selective Foresight for filtering low-confidence predictions. Experimental results on ALFWorld and ScienceWorld show that WorldEvolver significantly improves prediction accuracy and downstream agent success rates compared to existing world model baselines, highlighting the benefits of test-time memory revision.
WorldEvolver redefines LLM agent planning by achieving unprecedented prediction accuracy and decision-making success through self-evolving memory mechanisms.
World models offer a principled way to equip long-horizon LLM agents with foresight: predictions of action consequences before execution. However, unreliable foresight can be ignored, misused, or even degrade downstream decision-making. In this paper, we introduce WorldEvolver, a self-evolving world model framework that revises its deployment-time context while keeping the downstream agent and all model parameters frozen. WorldEvolver integrates three modules: (i) Episodic Memory, which exploits real action transitions through retrieval-based simulation; (ii) Semantic Memory, which extracts persistent heuristic rules from prediction-observation mismatches; and (iii) Selective Foresight, which filters low-confidence predictions before integrating them into agent reasoning context. We evaluate WorldEvolver on ALFWorld and ScienceWorld, measuring world model prediction accuracy on Word2World and downstream agent success rate on AgentBoard. Extensive experiments show that WorldEvolver achieves the highest prediction accuracy across three backbones and leads other world model baselines on downstream agent success rate, demonstrating that test-time memory revision enhances both predictive fidelity and planning performance.
NUS