Search papers, labs, and topics across Lattice.
This paper introduces a deepfake detection framework robust to real-world degradations by training a DINOv2-Giant backbone with extreme compound degradations to extract invariant geometric and semantic priors. The framework uses a multi-stream architecture with Global Texture, Localized Facial, and Hybrid Semantic Fusion streams to capture complementary features. By ensembling these streams with a calibrated voting mechanism, the model achieves stable zero-shot generalization, demonstrated by a strong performance in the NTIRE 2026 Robust Deepfake Detection Challenge.
Deepfake detectors can be made far more robust to real-world image corruptions by training on heavily degraded data and ensembling complementary feature streams.
Current deepfake detection models achieve state-of-the-art performance on pristine academic datasets but suffer severe spatial attention drift under real-world compound degradations, such as blurring and severe lossy compression. To address this vulnerability, we propose a foundation-driven forensic framework that integrates an extreme compound degradation engine with a structurally constrained, multi-stream architecture. During training, our degradation pipeline systematically destroys high-frequency artifacts, optimizing the DINOv2-Giant backbone to extract invariant geometric and semantic priors. We then process images through three specialized pathways: a Global Texture stream, a Localized Facial stream, and a Hybrid Semantic Fusion stream incorporating CLIP. Through analyzing spatial attribution via Score-CAM and feature stability using Cosine Similarity, we quantitatively demonstrate that these streams extract non-redundant, complementary feature representations and stabilize attention entropy. By aggregating these predictions via a calibrated, discretized voting mechanism, our ensemble successfully suppresses background attention drift while acting as a robust geometric anchor. Our approach yields highly stable zero-shot generalization, achieving Fourth Place in the NTIRE 2026 Robust Deepfake Detection Challenge at CVPR. Code is available at https://github.com/khoalephanminh/ntire26-deepfake-challenge.
