Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This paper investigates world model generalization by introducing AnyGoal, a benchmark designed to test compositional generalization on goal-shifted tasks where familiar state-action factors are recombined. The study reveals that current world models consistently fail to generalize to these novel combinations, despite individual factors remaining within training support. The analysis identifies specific areas of dynamics and representation failures across various model families and interaction regimes, highlighting challenges for future research in robust world modeling for planning.
Current world models fail to generalize to novel task combinations, even when individual components are familiar, suggesting a fundamental limitation in their compositional understanding of environment dynamics.
The goal of a world model is to capture the dynamics of an environment. This has the great appeal that it allows agents to plan and simulate a course of actions with the help of a world model. For these uses to be reliable, however, the learned dynamics must behave well beyond the specific state-action combinations observed in expert rollouts. Despite this, the relationship between data coverage, dynamics generalization, and downstream planning performance remains underexplored. We study this relationship through the lens of compositional generalization: can a world model recombine familiar state and action factors into valid dynamics? To answer this, we introduce AnyGoal, a benchmark of goal-shifted task variants built from widely used world-model environments, together with an open-source library. Each task is designed to be within reach of a world model that has learned the underlying dynamics: individual state factors and actions remain within their training support, but their combinations are underrepresented in expert trajectories. Across multiple environments and world model families, we find that current models consistently exhibit failures under these recombinations. By examining dynamics and representation failures across model families, interaction regimes, and evaluation metrics, we study where current world models generalize and where challenges remain for goal-shifted prediction and planning. Together, this framework, benchmark, and analysis provide a basis for evaluating progress toward world models that generalize to new planning tasks.
Mila