Search papers, labs, and topics across Lattice.
This paper introduces PHANTOM, a comprehensive open-source dataset comprising 47,524 pre-generated adversarial attacks specifically designed for vision-language models (VLMs). By categorizing attacks into 10 high-level categories and 55 subcategories, the dataset enhances existing benchmarks and provides a realistic evaluation resource for assessing model robustness and alignment. The initiative aims to democratize access to adversarial data, enabling researchers to systematically evaluate and improve VLM safety under diverse conditions.
A staggering 47,524 adversarial samples reveal vulnerabilities in vision-language models, paving the way for more robust AI systems.
We introduce a large-scale, open-source dataset of pre-generated adversarial attacks for vision-language models (VLMs). The dataset is designed to be diverse, representative, and practical, extending existing benchmarks by covering 10 high-level categories and 55 subcategories of harmful intents. Our primary goal is to make adversarial data accessible to the research community, given the computational cost and complexity of generating large numbers of attacks. The dataset comprises 47 524 adversarial samples, generated using state-of-the-art attack strategies from recent literature. Our work complements existing efforts by consolidating and extending prior benchmarks from multiple established sources, resulting in 7 826 intents, and introduce an additional category to broaden coverage. This provides realistic evaluation resources for studying model robustness and alignment. Our dataset intends to enable researchers and practitioners to systematically evaluate the robustness and safety of VLMs, fine-tune attack-generation models, and develop or stress-test defensive guardrails under diverse adversarial conditions. By releasing this resource, we aim to lower the barrier to adversarial research and foster more reproducible, comprehensive, and comparable evaluations of VLM safety.
