Search papers, labs, and topics across Lattice.
This paper introduces ARENA, an automated red-teaming framework specifically designed for large audio-language models (LALMs) to identify safety vulnerabilities that text-only methods cannot expose. By employing a closed-loop system that utilizes a 2,000-case text-audio dataset, ARENA effectively trains a controller to ensure that text queries remain safe while inducing harmful behaviors through joint audio inputs. The results demonstrate high effectiveness, achieving false discovery rates (FDR) and positive success rates (PSR) across multiple LALMs, indicating a significant advancement in the safety evaluation of audio-grounded AI systems.
ARENA uncovers vulnerabilities in large audio-language models that traditional text-based red-teaming methods miss, achieving near-perfect safety metrics across multiple systems.
Large audio-language models (LALMs) make it possible to interact with language models through speech, music, and environmental sound, but they also introduce a safety surface that is difficult to expose with text-only red-teaming. We study automated audio-grounded red-teaming, where a text query must remain safe in isolation while the joint text-audio input induces harmful target behavior. We propose ARENA, a closed-loop framework that trains a controller on an independent 2,000case text-audio dataset. MD-Judge supplies training rewards and adaptive search feedback, while a separate, non-adaptive Llama Guard 3 evaluator alone labels final outcomes. On 520 held-out AdvBench objectives, ARENA achieves FDR/PSR of 87.9/100.0%, 71.5/96.3%, 68.1/100.0%, and 75.4/98.5% on Audio Flamingo 3, Qwen2-Audio, MiMo-Audio, and GPTAudio, respectively. Ablations show that feedback-based refinement and audio-variant search substantially improve attack discovery.
