Search papers, labs, and topics across Lattice.
This study introduces an audio-native explainability pipeline that utilizes Integrated Gradients on time-aligned self-supervised representations to enhance the interpretability of deepfake speech detectors. By applying this method to three WavLM-based detectors, the researchers identify and annotate the most significant audio cues influencing detection decisions, revealing that each detector prioritizes different aspects of the audio signal. The findings demonstrate that while the detectors perform similarly, they rely on distinct cues, and causal masking validates the importance of these cues by showing performance degradation when they are obscured.
Deepfake speech detectors reveal surprising reliance on distinct audio cues, challenging assumptions about their decision-making processes.
Deepfake speech detectors often output a single score without explaining why an audio sample is flagged, where in the signal the evidence lies, or what cues drive the decision. We propose an audio-native explainability pipeline using Integrated Gradients on time-aligned self-supervised representations to localize decision evidence over time. We apply the proposed method to three WavLM-based detectors (AASIST, CA-MHFA, SLS) on ASVspoof 5 and manually annotate the highest-attribution regions to provide a semantic meaning of the most important cues. Despite similar performance, the detectors rely on different cues: AASIST emphasizes non-speech/environment cues, CA-MHFA focuses on localized phoneme artifacts, and SLS relies on word boundaries and spectral integrity. We move beyond speculative reasoning and validate our findings by causal masking of the primary detector cues. Observed performance degradation further supports the explained detector semantics.
