Search papers, labs, and topics across Lattice.
This paper introduces SPHINX, a closed-loop framework for generating adversarial driving scenarios that focuses on diagnosing the weaknesses of autonomous vehicle decision-making policies. By utilizing explainable AI methods, SPHINX first analyzes the policy's failures and then generates targeted scenarios that address specific issues, such as indecisiveness and multi-frame inconsistency. The results show that SPHINX significantly improves robustness across various state-of-the-art autonomous vehicle architectures compared to existing methods.
SPHINX reveals that understanding a policy's failures leads to more effective adversarial scenario generation, enhancing the robustness of autonomous driving systems.
Generating adversarial driving scenarios is critical for evaluating and improving autonomous vehicle decision-making systems in simulation. Recent approaches, such as ChatScene and LLM-Attacker, rely primarily on the prior knowledge of Large Language Models and Vision-Language Models to generate driving scenarios procedurally. We argue that adversarial scenes should be generated based on the failure diagnosis (e.g., indecisiveness, multi-frame inconsistency) of the driving policy to specifically address the policy's weaknesses instead of relying on prior assumptions. In this paper, we propose SPHINX, a closed-loop framework for adversarial scenario synthesis guided by a simple principle: first explain, then explore. Beyond blindly exploring the scenario space, SPHINX leverages explainable artificial intelligence methods to analyze the policy, identifying key visual concepts and their influence on policy outputs, and the uncertainty of the decisions. Given the interpretable evidence extracted from the policy's own decision process, we use a vision language model to rationalize and criticize failure modes of the current policy. These critics are then used to generate targeted adversarial scenarios for policy retraining and improvement. We demonstrate that SPHINX can highlight an interpretable account of policy failures while other adversarial scene generation cannot. Across the evaluated benchmarks and test suites, SPHINX can be applied to diverse state-of-the-art autonomous vehicle architectures and yields consistent robustness improvements over existing scenario-generation methods.
