Search papers, labs, and topics across Lattice.
M$^\text{4}$World is a novel multi-view and multimodal generative driving world model that synthesizes future video streams and LiDAR scans while enabling interactive object manipulation and stable minute-long streaming. The model employs a flexible conditioning interface for fine-grained control over object layouts and appearances, alongside a multi-stage training framework that achieves coherent world dynamics in just four denoising steps. Experimental results indicate that M$^\text{4}$World excels in generation quality, controllability, and stability, making it a significant advancement for scalable autonomous-driving simulations.
Achieving stable minute-long streaming and fine-grained object manipulation in driving simulations could revolutionize how we approach autonomous vehicle training environments.
Driving-world generation has emerged as a core capability for scalable autonomous-driving simulation, yet existing methods remain limited in object-level controllability and long-horizon stability. We present M$^\text{4}$World, a Multi-view and Multimodal generative driving world model that synthesizes future surround-view video streams and synchronized LiDAR scans while supporting interactive object Manipulation and stable Minute-long streaming. Fine-grained object manipulation is realized through a flexible conditioning interface that supports explicit control over both the spatial layout and visual appearance of individual objects. Stable minute-long streaming, on the other hand, is achieved through a multi-stage training framework that enables online causal generation in only four denoising steps while maintaining coherent world dynamics throughout extended rollouts. Building on these components, we introduce an efficient few-clip post-training as well as a suite of visual reference-conditioned generation models, preserving general generation ability while allowing rare-case customization for long-tail controllability. To assess controllability beyond realism, we further introduce an automated VLM-based judging pipeline that evaluates scene-level condition adherence, view-wise object controllability, and cross-view object consistency. Comprehensive experiments show that M$^\text{4}$World consistently delivers high generation quality, precise controllability, and stable minute-long streaming. Together with downstream long-tail augmentation and scene editing, these results demonstrate the potential of M$^\text{4}$World for controllable, scalable driving simulation.
