Search papers, labs, and topics across Lattice.
This paper introduces Value Diffusion World Models (Valdi), which integrate end-to-end online training for Model Predictive Control (MPC) with a latent diffusion dynamics model to enhance dynamics prediction for uncertain futures. The authors address the challenge of using diffusion models for low-latency planning by employing a single diffusion step during both training and inference, achieving performance on par with a deterministic MLP baseline in the CarRacing environment. Key findings reveal a trade-off between predictive multimodality and control performance, highlighting the nuanced balance necessary for effective MPC applications.
A single diffusion step can match the performance of traditional deterministic models in dynamic environments, revealing new avenues for efficient online planning.
World models can enable Model Predictive Control (MPC), but this requires dynamics prediction that is both fast enough for online use and expressive enough to represent uncertain futures. Diffusion models offer a natural mechanism for modeling uncertain dynamics, yet their iterative inference procedure makes them difficult to use for low-latency latent planning. We bridge this gap with Value Diffusion World Models (Valdi), combining end-to-end online training for MPC with a latent diffusion dynamics model. In preliminary experiments on the CarRacing environment, we show that Valdi, using a single diffusion step at both training and inference, matches a deterministic MLP baseline. Our experiments expose a trade-off between predictive multimodality and control performance in this setup. Code is available at https://github.com/Kit115/ValueDiffusionWorldModels.
