Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the ability of a frozen DreamerV3 model to identify and utilize a conserved scalar invariant while predicting video from pendulum dynamics. The authors demonstrate that a label-free search successfully recovers this energy-like invariant across various conservative models, while similar models with damping do not exhibit such invariants. By projecting the latent state back to its initial level set during rollouts, they significantly reduce prediction errors, highlighting a critical failure mode where learned physical constraints are violated in imagined scenarios.
A learned physical invariant can drastically improve the accuracy of world-model rollouts, revealing a critical gap in how models handle dynamics versus their learned representations.
World models can predict video without learning dynamics that they reliably preserve. We test whether a frozen DreamerV3 trained only on pendulum video learns a scalar that its own latent transition treats as approximately conserved. A label-free search recovers the same energy-like invariant across independently trained conservative models, while the same procedure finds no comparable invariant in matched damped models. During autonomous rollouts, this quantity drifts. Projecting the latent state back toward its initial level set reduces rollout error in all three conservative models, whereas matched random constraints usually increase it. These results distinguish a dynamically meaningful invariant from a merely decodable correlate and reveal a concrete failure mode: a world model can learn a physical constraint from pixels yet violate that constraint when it imagines forward.