Search papers, labs, and topics across Lattice.
This paper introduces the MSCA-FFT framework, which leverages a multi-scale cross-attention mechanism to enhance deepfake detection by integrating spatial and frequency features through a Fast Fourier Transform (FFT) approach. The model employs a partially fine-tuned Xception network for spatial analysis and a shallow convolutional architecture for processing the log-scaled FFT magnitude spectrum, avoiding the need for inverse reconstruction. Experimental results demonstrate that MSCA-FFT outperforms existing DCT-based methods and baseline models, highlighting the importance of frequency information in identifying manipulated content.
Combining spatial and frequency features through a novel FFT-based framework, MSCA-FFT significantly boosts deepfake detection accuracy, revealing manipulation-sensitive facial regions.
Deepfake generation has raised growing concerns regarding digital media authenticity, misinformation, identity fraud, and public trust. Recent studies show that combining spatial and frequency features leads to stronger detection results than using independently. This paper presents MSCA-FFT, a Fast Fourier Transform (FFT)-based multi-scale cross-attention framework for image-level deepfake detection. The model combines a partially fine-tuned Xception spatial branch with an FFT-based frequency branch. The frequency branch processes the log-scaled FFT magnitude spectrum through shallow convolutional layers, avoiding inverse frequency-to-image reconstruction used in DCT-based pipelines. The spatial and frequency representations are refined by transformer encoders, fused through cross-attention, and passed to an MLP classifier for real/fake prediction. Experimental results show that MSCA-FFT achieves consistently higher performance than the DCT-based state-of-the-art spatial-frequency fusion method and the compared baseline models. The ablation study further indicates that the FFT-based frequency branch provides complementary spectral cues when fused with spatial features. In addition, FFT-based frequency analysis and Grad-CAM/LIME explanations show consistent evidence around manipulation-sensitive facial regions, including the eyes, mouth, nose, and facial boundaries.
