Search papers, labs, and topics across Lattice.
This survey analyzes adversarial vulnerabilities in Multimodal Large Language Models (MLLMs), categorizing attacks based on attacker objectives across modalities and deployment settings. It moves beyond a simple enumeration of attacks by linking integrity violations, safety failures, control hijacking, and training-time poisoning to shared architectural and representational weaknesses. The paper provides a framework for understanding adversarial behavior, informing the development of more robust MLLMs.
MLLMs are riddled with shared vulnerabilities across modalities, meaning a single weakness can be exploited to jailbreak safety filters, hijack instructions, or even poison training data.
Multimodal large language models (MLLMs) integrate information from multiple modalities such as text, images, audio, and video, enabling complex capabilities such as visual question answering and audio translation. While powerful, this increased expressiveness introduces new and amplified vulnerabilities to adversarial manipulation. This survey provides a comprehensive and systematic analysis of adversarial threats to MLLMs, moving beyond enumerating attack techniques to explain the underlying causes of model susceptibility. We introduce a taxonomy that organizes adversarial attacks according to attacker objectives, unifying diverse attack surfaces across modalities and deployment settings. Additionally, we also present a vulnerability-centric analysis that links integrity attacks, safety and jailbreak failures, control and instruction hijacking, and training-time poisoning to shared architectural and representational weaknesses in multimodal systems. Together, this framework provides an explanatory foundation for understanding adversarial behavior in MLLMs and informs the development of more robust and secure multimodal language systems.
Google Research