Search papers, labs, and topics across Lattice.
This paper introduces the Disentangled Video Generation World Model (DVG-WM), which separates the tasks of dynamics learning and visual synthesis to enhance video-based embodied world models for robotic manipulation. By generating intermediate visual states conditioned on initial observations and language instructions, DVG-WM achieves high-fidelity video outputs while significantly improving inference speed. Experiments show that this approach can accelerate video generation by up to 3.97 times while maintaining detail in contact-rich scenarios, addressing the limitations of current entangled models.
Disentangling dynamics from visual synthesis allows robotic systems to generate high-quality videos up to four times faster without losing critical interaction details.
Video-based embodied world models provide an appealing substrate for robotic manipulation by predicting future states, yet current approaches remain limited by a fundamental entanglement: accurately modeling dynamics typically requires low-level temporal reasoning, while producing high-resolution frames demands expansive visual synthesis according to high-level semantics. This entanglement results in slow inference speed for iterative planning or too coarse predictions to retain contact-rich details. To solve this dilemma, we present Disentangled Video Generation World Model (DVG-WM), an efficient framework that explicitly decomposes world modeling into dynamics learning and visual synthesis. Conditioned on an initial observation and a language instruction, our model first generates a plausible sequence of intermediate visual states to preview the physical interaction and refines them to obtain high-fidelity videos. Furthermore, an efficient cascading mechanism is proposed, where DVG-WM uses flow matching to directly map the dynamics to video latents, and introduces a latent degradation mechanism to regenerate contact-rich details. Experiments on LIBERO and real-world platforms demonstrate improved video quality with up to 3.97 times acceleration, validating that disentangled video generation can be an efficient embodied world model for robotic manipulation.
