Search papers, labs, and topics across Lattice.
NVIDIAArchon RoboticsHKUHuaweiShanghai InnovationT眉bingenUW-MadisonvaleoJun 18, 2026arXiv:2606.19836This paper introduces World Engine, a generative framework that enhances the safety of autonomous driving by post-training pre-trained driving models on synthesized high-stakes interactions derived from real-world logs. By addressing the scarcity of safety-critical "long-tail" events in existing datasets, the framework enables reinforcement-based post-training that aligns driving policies with safety constraints without the risks of real-world exploration. The results demonstrate a significant reduction in failures during rare safety-critical scenarios and improved performance in simulated and on-road testing, highlighting the effectiveness of this approach over merely scaling pre-training data.
Post-training on synthesized safety-critical scenarios can dramatically enhance the reliability of autonomous driving systems, reducing failures in rare but critical events.
Autonomous vehicles must operate safely in the real world, where errors can have severe consequences. Although modern end-to-end driving policies excel in routine scenarios, their reliability is limited by the scarcity of safety-critical ``long-tail'' events in real driving datasets. These rare interactions define the practical safety boundary of the learned policy, yet they are difficult to collect at scale in the real world. Here we show that this fundamental limitation can be addressed by post-training pre-trained driving models on synthesized high-stakes interactions. We introduce World Engine, a generative framework that reconstructs high-fidelity interactive environments from real-world logs and systematically extrapolates them into realistic safety-critical variations. This paradigm enables reinforcement-based post-training to align policies with safety constraints, circumventing the physical risks inherent in real-world exploration. On a public benchmark built on nuPlan, World Engine substantially reduces failures in rare safety-critical scenarios and yields significantly larger gains than scaling pre-training data alone. Furthermore, when deployed on a production-scale autonomous driving system, the resulting policy reduces simulated collisions and demonstrates measurable improvements in on-road testing, showing that post-training on synthesized, safety-critical interactions offers a scalable and effective pathway to safer autonomous driving. The full codebase suite, including training, is released to the public.
