Search papers, labs, and topics across Lattice.
This paper introduces ODEWorld, a continuous-time latent world model that leverages Physical-Time Flow (PT-Flow) to learn a continuous latent velocity field governed by ordinary differential equations (ODEs). By integrating temporal dynamics in a compressed latent space, ODEWorld effectively mitigates representation collapse and enables high-quality image reconstruction over long horizons. Experimental results show that ODEWorld excels in both video generation and robotic control, offering a versatile framework for planning-oriented applications in machine learning.
ODEWorld achieves high-quality long-horizon predictions and planning-oriented dynamics by seamlessly integrating continuous-time modeling with ODE-based representations.
In the physical world we inhabit, space and time are fundamentally continuous. However, existing machine learning paradigms for world modeling are largely confined to discrete-time prediction, thereby exhibiting significant inefficiency in capturing the dynamics of physical world. We introduce Physical-Time Flow (PT-Flow), a novel approach that learns a continuous latent velocity field operating in physical time. Crucially, the underlying dynamics of sequential data are parameterized by an ordinary differential equation (ODE) embedded in a well-structured representation space. Under this paradigm, the prediction of future can be recast as temporal integration via an ODE solver in the compressed latent space. Building upon PT-Flow, we construct ODEWorld, a continuous-time latent world model that is both efficient and versatile. By extracting time-variant features and enforcing ODE properties on both the dynamical representation space and the latent velocity field, ODEWorld effectively addresses the long-standing representation collapse issue in latent world model literature. This also enables high-quality image reconstruction even after long-horizon prediction. Moreover, its continuous nature allows for arbitrary temporal resolution and even backward prediction, which is impossible for most discrete-time models. Lastly, ODEWorld can provide rich planning-oriented information to facilitate downstream policy learning. Comprehensive experiments demonstrate that ODEWorld successfully reconciles planning-conducive dynamics abstraction with visual realism, excelling in both video generation and robotic control. https://dstate.github.io/odeworld_website/{Project Website}.