Search papers, labs, and topics across Lattice.
Tsinghua AIAI LaboratoryBeihangBusiness CollegeCASGuangzhou City University of TechnologyiFlytekInceptio TechnologyInstitute of DataspaceJHUJiangnanNortheasternNTUOxfordthe Yangtze River DeltaTongjiUniversity of CaliforniaZhongguancun LaboratoryJul 13, 2026arXiv:2607.11560This report details the CVPR 2026@AdvML Workshop Challenge focused on adversarial multimodal attacks against vision-language agents (VLAs) used in autonomous driving. By utilizing a DriveLM-style framework with multi-view visual question answering, participants created adversarial images and textual perturbations to manipulate model outputs while maintaining fidelity. Key findings reveal that image-side attacks are more effective due to suffix penalties, and multi-view optimization strategies significantly enhance attack efficacy, highlighting vulnerabilities in current VLA systems.
Adversarial attacks on vision-language agents reveal critical vulnerabilities, with multi-view optimization strategies proving significantly more effective than isolated approaches.
Vision-language agents (VLAs) are increasingly used to interpret complex driving scenes and support safety-critical reasoning. This report presents the CVPR 2026@AdvML Workshop Challenge on adversarial multimodal attacks against autonomous-driving VLAs. Built on DriveLM-style multi-view visual question answering, the challenge represents each scene with six synchronized camera images and a structured collection of driving-related question-answer pairs. Participants generate adversarial images and suffix-only textual perturbations that induce model responses to deviate from reference answers while preserving image fidelity and limiting textual cost. The competition comprises two phases, with Phase II adding a hidden black-box model to assess transferability. We describe the task design, submission rules, evaluation protocol, and leaderboard results, and then examine five leading submissions for which technical reports were available. Across these reports, several recurring patterns emerge: image-side attacks are favored by the suffix penalty; scene-level, multi-view optimization is more effective than treating views in isolation; QA types and graph structure provide useful priors for allocating attack budget; feature-space objectives can improve black-box transfer; and typographic content embedded in camera images exposes a persistent vulnerability in driving VLAs. These findings provide a practical reference for future robustness evaluation and defense design in multimodal autonomous-driving systems.
