Search papers, labs, and topics across Lattice.
This paper introduces GraphWorld, an end-to-end autonomous driving framework that enhances long-horizon planning through latent world modeling. By employing an Ego-Centric Interaction Graph, the model captures critical interactions between the ego vehicle and surrounding agents, enabling it to propagate relational context for improved trajectory planning. Experimental results on multiple driving benchmarks show that GraphWorld significantly reduces collision rates and enhances performance in complex driving scenarios, addressing a key limitation of existing methods that struggle with long-term dependencies.
Long-horizon planning in autonomous driving just got a major upgrade, with GraphWorld cutting collision rates and boosting performance in complex environments.
End-to-end autonomous driving has made significant progress by unifying perception, prediction, and planning within a single learning framework, achieving strong performance in short-horizon decision making. However, most existing E2E-AD methods remain confined to short-horizon planning and lack the ability to model long-term temporal dependencies, which severely limits their generalization and security in complex and highly interactive driving scenarios. In this work, we propose GraphWorld, an E2E-AD framework that explicitly enhances long-horizon planning through latent world modeling. We introduce an Ego-Centric Interaction Graph, which adaptively models critical neighboring agents based on spatial proximity, and propagates relational context to planning queries via cross-node cross-attention. We present a World-State-Conditioned Planning that learns ego-centric latent world representations by modeling interactions between an ego vehicle and surrounding agents. This latent world state captures key interaction dynamics and safety-relevant semantics, and serves as a conditioning signal to guide long-horizon, safety-aware trajectory planning. Extensive experiments on Bench2Drive, NAVSIMv1/2, and nuScenes demonstrate that GraphWorld significantly reduces collision rates and improves long-horizon planning performance, validating its effectiveness in complex driving environments.