Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This tutorial clarifies the conceptual landscape of world models in robotics by categorizing them into observation-space and state-space models, highlighting their trade-offs in visual fidelity, spatial structure, and control usability. It introduces the novel concept of world action models, which link predictive futures with actionable robot behaviors, and summarizes four paradigms for implementing these models. By providing a structured taxonomy, the paper aims to enhance understanding and application of embodied prediction and control in robotic systems.
World action models could revolutionize how robots predict and execute actions by directly linking future observations to real-time decision-making.
World models are increasingly used in embodied intelligence and generative simulation, yet their scope remains ambiguous across communities. This tutorial presents a design-space view of world models as action-conditioned predictive models that estimate the future evolution of task-relevant observations or states. We categorize existing methods into observation-space and state-space world models, comparing their trade-offs in visual fidelity, spatial structure, physical interpretability, and control usability. We further introduce world action models, which connect predicted futures with executable robot actions, and summarize four representative paradigms: imagine-then-execute, video-feature-conditioned action prediction, joint video-action modeling, and auxiliary video prediction for policy learning. The goal of this tutorial is to clarify the conceptual scope of world (action) models and provide a structured taxonomy for embodied prediction and control.