Search papers, labs, and topics across Lattice.
This study investigates the susceptibility of Vision Language Models (VLMs) to adversarial perturbations in visual inputs, focusing on both untargeted and targeted evasion attacks. By employing a gradient-based attack method that optimizes only the vision encoder, the authors significantly reduce the computational burden while effectively generating adversarial examples. The results reveal that minor, imperceptible changes to images can drastically alter the textual outputs of various open-source VLMs, underscoring a critical vulnerability in multimodal AI systems.
Small, human-imperceptible image perturbations can drastically mislead Vision Language Models, revealing a significant security flaw in multimodal AI systems.
Vision Language Models (VLMs) have recently emerged as a critical component of multimodal AI systems, enabling joint reasoning over visual and textual inputs in real-world and safety-critical applications. Despite their growing deployment, the robustness of VLMs against adversarial threats remains insufficiently explored, particularly in the context of evasion attacks targeting multimodal alignment. In this work, we investigate the vulnerability of VLMs to adversarial perturbations applied to visual inputs and study two attack settings: untargeted attacks, where the goal is to disrupt the model's interpretation of the original image, and targeted attacks, where the adversary aims to force the model to generate a specific semantic description unrelated to the original image. To efficiently generate adversarial examples, we propose a gradient-based attack method that performs optimization exclusively on the vision encoder of the VLM rather than on the entire multimodal architecture. This design significantly reduces the computational cost and resource requirements of the attack while maintaining strong effectiveness. We evaluate our approach on several open-source VLMs, including Qwen2.5-VL, Granite-Vision, FastVLM, and Phi-3.5-Vision, and show that small, human-imperceptible perturbations can substantially alter the textual interpretation produced by the models. Our findings highlight the vulnerability of modern VLMs to adversarial manipulation and emphasize the need for improved robustness and security mechanisms in multimodal AI systems.
