Search papers, labs, and topics across Lattice.
This study investigates the impact of image resolution on the ability of large vision-language models (VLMs) to detect harmful ASCII art, a method often used to bypass content moderation systems. By evaluating eight state-of-the-art VLMs across various character construction modes and languages, the researchers found that detection rates significantly decline beyond specific resolution thresholds, with word-embedded designs proving particularly resistant. These results highlight a critical vulnerability in current VLM moderation tools and suggest the need for resolution-aware evaluation standards to enhance safety measures.
Detection rates for harmful ASCII art plummet beyond certain resolution thresholds, exposing a critical vulnerability in VLM moderation systems.
Large Vision-Language Models (VLMs) are increasingly deployed as content moderation tools, yet they remain vulnerable to jailbreak attacks in which harmful text is visually encoded as ASCII art. This can allow inappropriate or harmful content to bypass moderation systems. To address this vulnerability, this paper investigates how image resolution affects VLM detection of harmful ASCII art across eight character construction modes (L1-L8), ranging from dense block characters to word-embedded designs. We evaluate eight state-of-the-art VLMs on English and Chinese corpora using a pipeline that generates ASCII art images at ten resolution scales, probing whether a consistent detection-failure threshold exists across models, modes, and languages. Results indicate that detection rates decline sharply above certain resolution thresholds, and that word-based modes are the most resistant to detection across the full resolution range. These findings reveal a systematic vulnerability in VLM-based content moderation systems and motivate resolution-aware evaluation standards.
