Search papers, labs, and topics across Lattice.
This paper introduces AdaForensics, a novel adaptive network for deepfake detection that learns both characteristic-agnostic and characteristic-specific embeddings to tailor detection capabilities to individual facial features. Unlike traditional methods that apply a uniform detector across all images, AdaForensics leverages a two-branch HyperNetwork to dynamically adjust its parameters based on the unique characteristics of each input face. Extensive evaluations on benchmark datasets, including FaceForensics, Celeb-DF, and DFDC, reveal that AdaForensics significantly outperforms existing state-of-the-art deepfake detection methods.
Tailoring deepfake detection to individual facial characteristics boosts accuracy and adaptability beyond traditional fixed architectures.
In this paper, we propose a characteristic-aware adaptive network named AdaForensics for deepfake detection. Most existing methods learn a fixed network to detect deepfakes based on carefully-designed network architectures. However, these methods employ the same deepfake detector for all the images despite of various facial characteristic, which fail to provide customized forgery detection for different individuals. To address this, our AdaForensics simultaneously learns characteristic-agnostic and characteristic-specific embeddings, where the detector dynamically adapts to varying faces with our designed hypernetwork on the fly. More specifically, our AdaForensics not only explores the shareable abstractions from various deepfake images, but also adapts the detector to the given characteristic at test time. To achieve this, we propose a two-branch HyperNetwork to learn an adaptive deepfake detector, which automatically adjusts the parameters based on characteristic of the input. Extensive experiments on widely-used datasets including FaceForensics, Celeb-DF and DFDC demonstrate our AdaForensics outperforms the state-of-the-art works.
Tsinghua AI