Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the vulnerabilities of multimodal large language models (MLLMs) to malicious video inputs, revealing that the number and diversity of video clips significantly increase the likelihood of bypassing safety measures. Through the introduction of the Multi-Clip Video (MCV) SafetyBench dataset, comprising 2,920 videos, the research demonstrates that MLLMs are more susceptible to dynamic and contextually diverse videos compared to static images. The findings highlight a critical need for enhanced safety protocols in MLLMs, particularly in video processing scenarios, and propose a defense strategy that utilizes the relative robustness of image inputs.
Attack success rates for MLLMs soar with the number of video clips, revealing a stark vulnerability in video processing that outstrips image-based threats.
As multimodal large language models (MLLMs) have advanced to process video inputs, concerns have emerged about their potential for malicious misuse. Prior jailbreak studies have shown that safety alignment in MLLMs can be bypassed through visual inputs, yet it remains unclear which properties of video inputs induce this vulnerability. To address this gap, we introduce Multi-Clip Video (MCV) SafetyBench, a dataset of 2,920 videos designed to evaluate how the diversity of video inputs affects the vulnerability of MLLMs. Each video consists of multiple short clips depicting diverse contexts related to a harmful query. Experiments on eight representative video MLLMs show that attack success consistently increases with the number of clips. Our results further indicate that the video modality is (1) more vulnerable than the image modality, (2) more vulnerable to dynamic videos than to static videos, and (3) more vulnerable when videos contain more diverse contexts. Building on these findings, we propose a defense strategy that leverages the relative robustness of the image modality.