Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a mix-frame post-training strategy that enhances speech foundation models for detecting deepfakes by creating localized spoof-oriented perturbations and employing frame-level supervision. The approach addresses the limitations of direct fine-tuning, which struggles with the mismatch between pre-training objectives and the specific artifacts of spoofed audio. The authors achieve a state-of-the-art Equal Error Rate (EER) of 4.50% on ASVspoof5 and a minimal 0.16% EER gap between logical and deepfake audio on ASVspoof2021, demonstrating the method's effectiveness in improving robustness against various distortion conditions.
Achieving a state-of-the-art EER of 4.50% in speech deepfake detection reveals the power of localized perturbations in post-training strategies.
Large speech foundation models have shown strong potential for speech deepfake detection, but direct fine-tuning is limited by a mismatch between self-supervised pre-training objectives and spoof-specific artifacts. To address this, we propose a mix-frame post-training strategy to create localized spoof-oriented perturbations and use frame-level supervision to encourage the SSL model to learn local inconsistencies that are critical for robust spoof detection. On ASVspoof5, we achieve state-of-the-art EER 4.50% for a single model without data augmentation. On ASVspoof2021 LA/DF, it further achieves only 0.16\% absolute EER gap between LA and DF, indicating strong and balanced robustness across distinct distortion conditions. These results show that supervised post-training provides an effective and practical way to adapt speech foundation models for robust deepfake detection.