Search papers, labs, and topics across Lattice.
This paper introduces GeoWorldAD, a geometry world action model designed for autonomous driving that integrates explicit geometric grounding and anticipates future spatial changes to enhance trajectory planning in dynamic 3D environments. By leveraging ego-aligned 3D space and latent future geometry tokens, the model effectively balances collision avoidance with driving progress, allowing for more informed decision-making. Experimental results on NAVSIM v1 and v2 show that GeoWorldAD achieves state-of-the-art performance, underscoring the importance of geometric cues in improving safety and efficiency in autonomous driving systems.
Future-aware geometry tokens enable autonomous vehicles to make safer and more efficient driving decisions, outperforming existing models.
Autonomous driving requires both safe and efficient planning decisions in dynamic 3D environments. Although recent Vision/Video-Action models learn policies directly from visual observations and scale well with advances in vision transformers and large-scale training data, they often lack explicit geometric grounding and future-aware spatial guidance, limiting their ability to balance collision avoidance and driving progress. In this work, we propose GeoWorldAD, a geometry world action model that grounds trajectory planning in ego-aligned 3D space and anticipates short-horizon scene evolution with latent future geometry tokens. Present geometry provides essential spatial constraints for safe planning, while future geometry reveals how surrounding agents and ego-centric free space may evolve, reducing overly conservative decisions without sacrificing safety. To efficiently exploit these geometric cues, GeoWorldAD progressively aggregates multi-scale present geometry and latent future geometry through iterative trajectory refinement. Experiments on NAVSIM v1 and v2 demonstrate state-of-the-art performance, highlighting the effectiveness of explicit 3D geometry grounding and future geometry world modeling for safe and efficient autonomous driving.
