Search papers, labs, and topics across Lattice.
This study benchmarks face forgery detection performance using the Multi-Dimensional Face Forgery Image (MFFI) dataset, evaluating six model families under both clean and degraded conditions. The findings reveal that traditional clean-set performance metrics do not predict robustness against realistic image degradations, with Xception achieving the highest clean performance but suffering significant degradation under challenging conditions. In contrast, the frozen DINOv3 model, trained only on a linear classification head, excels in degraded settings, highlighting the importance of self-supervised learning and hybrid input representations for enhancing detection reliability.
Clean performance metrics mislead expectations, as DINOv3 outperforms traditional models in real-world degradation scenarios.
Face forgery detectors often achieve strong results on controlled benchmarks, but their reliability under realistic image degradations remains limited. This paper presents a standardized benchmark for face forgery detection using the Multi-Dimensional Face Forgery Image (MFFI) dataset and evaluates performance on both clean and degraded test partitions. We compare six model families, including convolutional networks, transformer-based models, and a frozen self-supervised DINOv3 backbone, across spatial, spectral, and hybrid input representations. The results show that clean-set performance is not a reliable indicator of robustness under compression, resizing, and blurring. Xception with RGB obtains the best clean performance, reaching 0.884 mean ROC-AUC, but degrades substantially on the harder partition. In contrast, frozen DINOv3 achieves the strongest degraded-set result, with 0.726 mean ROC-AUC, while training only a linear classification head. The representation analysis indicates that Fourier-domain cues are most useful when combined with RGB information, whereas purely spectral inputs consistently underperform spatial representations. Qualitative attribution maps further suggest that convolutional detectors focus on localized artifacts, while DINOv3 relies on broader facial structure. These findings reinforce the need for degraded evaluation protocols and highlight self-supervised visual representations as a promising direction for robust face forgery detection. Our source code is publicly available at https://github.com/lucasdocunha/FaceForgery-Benchmark/.
