Search papers, labs, and topics across Lattice.
This paper investigates the vulnerability of LLM-based systems to multimodal hidden instruction attacks, revealing that current defenses inadequately address malicious intent conveyed through images. The authors introduce SkillCamo, a novel attack method that embeds harmful operational instructions within images and modifies accompanying documentation to seamlessly integrate these visuals into the workflow. To counter this threat, they propose ExecScan, a multimodal scanning module that effectively extracts intent and assesses risks by analyzing documentation, code, and visual content, demonstrating significant improvements in skill scanning performance against such attacks.
Malicious instructions hidden in images can bypass existing skill scanners, exposing a critical vulnerability in LLM-based systems.
Agent skills are emerging as an important attack surface in LLM-based systems. Through an empirical study of existing skill scanners, we find that current defenses primarily rely on textual descriptions, manifests, and source code as the main signals for security analysis, which can leave visually conveyed malicious intent insufficiently examined. This creates a practical blind spot: harmful operational instructions hidden in images may bypass scanning while still being recoverable by multimodal agents during deployment. To systematically investigate this threat, we propose SkillCamo, a document-mediated multimodal instruction attack that conceals malicious instructions within images bundled with a skill while rewriting the surrounding documentation to naturally reference those images as part of the normal workflow. Thus, the attack does not rely on the image alone, but on the joint interpretation of textual guidance and visual payload at execution time. To defend against such attacks, we further propose ExecScan, an execution-grounded multimodal scanning module that performs intent extraction, behavior reconstruction, abuse assessment, and deliberative execution simulation over skill artifacts. ExecScan jointly analyzes documentation, code, referenced resources, and visual content to recover hidden instructions, reconstruct executable behavior chains, and identify downstream risks such as exfiltration, destruction, persistence, deception, and privilege escalation. Extensive experiments show that image-hidden malicious instructions challenge existing skill scanners, while ExecScan can improve the skill scanning performance.