Search papers, labs, and topics across Lattice.
This paper introduces Adversarial World Modeling (AWM), a multi-agent self-play fine-tuning framework designed to enhance the robustness of motion planning in autonomous vehicles by simulating rare and critical traffic scenarios. By framing the learning process as a constrained min-max game, AWM effectively transforms the planner's predictive world model into a role-conditioned adversary that learns to create scene-adaptive attack coalitions. Experimental results on the nuPlan and InterPlan benchmarks show that AWM not only generates transferable adversarial interactions but also produces a robust planner that maintains competitive performance in both typical and challenging driving situations.
AWM enables autonomous vehicles to effectively learn from adversarial scenarios, significantly enhancing their robustness in rare and critical traffic conditions.
Robust motion planning in dense traffic requires autonomous vehicles to interact in rare and safety-critical scenarios that are underrepresented in naturalistic driving data. Although adversarial training offers a feasible solution, existing methods often rely on external scenario generators, heuristic perturbations, or simulator-heavy rollouts, which makes them difficult to integrate with modern autoregressive planners. Here, we cast adversarially robust planner learning as a constrained min-max game and propose Adversarial World Modeling (AWM), a theoretically grounded multi-agent self-play fine-tuning framework. Since solving the exact game is intractable, AWM introduces a principled decoupled solver. In the inner minimization, the planner's predictive world model is converted into a role-conditioned adversary that learns sparse, scene-adaptive attack coalitions via counterfactual credit assignment. In the outer maximization, the ego planner optimizes a regret-aware robust best response against the frozen AWM, utilizing tail-risk weighting and reference-anchored trust regions to improve hard-case recovery while preserving nominal driving behavior. Experiments on the nuPlan and InterPlan benchmarks demonstrate that our method generates transferable adversarial interactions and yields a robust planner that achieves competitive closed-loop performance in both nominal and highly interactive long-tail scenarios. Theoretical analysis justifies the decoupled solver and the main optimization components.
