Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SEAR, a novel audio question answering benchmark designed to evaluate audio language models (ALMs) on audio deepfake detection (ADD) by grounding their reasoning in verifiable acoustic evidence. The benchmark comprises four tasks focused on acoustic evidence identification, quantification, deepfake detection, and forensic rationale generation, revealing a significant disconnect between ALM-generated rationales and their actual acoustic evidence grounding. The authors also propose a bona-fide-based acoustic evidence agent (BAEA) that enhances ALM performance on both detection and rationale generation by incorporating controlled acoustic tool usage.
Most ALMs fail to ground their audio deepfake detection rationales in actual acoustic evidence, despite generating plausible explanations.
Audio language models (ALMs) are increasingly used for audio deepfake detection (ADD), yet existing benchmarks assess their verdicts or rationale plausibility without verifying the underlying acoustic evidence. To address this issue, we first introduce spoofing evidence-grounded audio reasoning (SEAR), a four-task AQA benchmark to evaluate ALM-based ADD through acoustic evidence identification and quantification, deepfake detection, and forensic rationale generation. We further propose a bona-fide-based acoustic evidence agent (BAEA), which equips a frozen ALM with controlled acoustic tools under \textsc{fixed} or \textsc{adaptive} evidence-acquisition policies. Experiments with six ALMs reveal a clear gap between plausible rationales and verifiable acoustic evidence reasoning, while BAEA-\textsc{Fixed} improves final verdicts and forensic rationales on both evaluation partitions. Controlled interventions further show that misleading evidence degrades both detection and grounding performance.