Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the vulnerability of speech deepfake detection (SDD) models to distortions from acoustic front-end (AFE) processing, which are prevalent in real-world applications. By simulating a comprehensive AFE pipeline, the authors reveal that current SDD models struggle with nonlinear and time-frequency coupled distortions, leading to significant performance degradation. To counter this, they introduce the Time-Frequency Consistency Learning (TFCL) framework, which employs an attention-driven soft alignment mechanism and frequency-domain structural consistency constraints, resulting in robust detection performance even under challenging conditions.
AFE processing can drastically undermine speech deepfake detection, but the TFCL framework ensures models remain resilient against these real-world distortions.
Recently, speech deepfake detection (SDD) has achieved significant progress. However, its robustness evaluation remains largely confined to controlled additive noise scenarios, lacking systematic investigation of the complex distortions introduced by acoustic front-end (AFE) processing pipelines in real-world deployments. In this work, we simulate a unified AFE pipeline comprising acoustic echo cancellation, noise suppression, automatic gain control, and voice activity detection (VAD), and conduct a comprehensive evaluation of current state-of-the-art models. The results show that the nonlinear and time-frequency coupled distortions introduced by AFE significantly degrade detection performance. To address this issue, we propose a Time-Frequency Consistency Learning (TFCL) framework, which aims to learn invariant spoofing representations that remain stable before and after AFE processing. We observe that AFE not only introduces temporal misalignment (e.g., segment-level shifts caused by VAD), but also weakens or distorts critical frequency-domain cues. To this end, TFCL employs an attention-driven soft alignment mechanism to capture cross-temporal dependencies, along with frequency-domain structural consistency constraints to enforce feature invariance. As a result, the model is able to maintain stable representations under both temporal perturbations and spectral distortions. Extensive experimental results demonstrate that the proposed method effectively mitigates the performance degradation caused by AFE processing, significantly improving the robustness of SDD in real-world scenarios. The code is available at https://github.com/JunXue-tech/TFCL.