Search papers, labs, and topics across Lattice.
This paper introduces DA-WAM, a novel framework that integrates predictive representation learning with decision-making in autonomous driving by ensuring that future scene predictions are directly linked to trajectory selection. By utilizing an action-conditioned predictor and a factorized scoring mechanism, DA-WAM allows for the co-evolution of future representations and driving tasks, maintaining predictive supervision during planning optimization. Extensive experiments on NAVSIM-v1 and NAVSIM-v2 show that DA-WAM achieves state-of-the-art performance, highlighting its effectiveness in aligning future modeling with decision-making objectives.
Future scene predictions can now directly influence trajectory selection in autonomous driving, enhancing decision-making accuracy.
Anticipating how scenes evolve under ego actions is fundamental to safe autonomous driving, yet the full potential of world models for decision-making remains unrealized. The critical challenge lies in ensuring that future modeling is not merely predictive, but decision-informative: the predicted future must directly shape which trajectory is selected. Existing approaches decouple future representation learning from planning optimization, or share predicted states across trajectory candidates, thereby diluting the action-specific consequences that ought to guide selection. To bridge this gap, we propose DA-WAM, a framework that unifies predictive representation learning, action-conditioned future modeling, and trajectory scoring under a single decision-making objective. DA-WAM maintains predictive supervision throughout planner optimization via an online encoder and a stable momentum target, allowing future representations to co-evolve with the driving task. An action-conditioned predictor generates a distinct future latent state per trajectory candidate, which is then evaluated by a future-latent-conditioned factorized scorer. For the expert-matched trajectory, the predicted future latent is supervised by the observed future representation, while safety-critical hard negatives provide additional supervision near planning boundaries. Extensive experiments on NAVSIM-v1 and NAVSIM-v2 demonstrate state-of-the-art performance, while ablations and diagnostic analyses validate the key components.
