Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a training-free method for detecting synthetic images by utilizing noise residual fingerprints extracted from a pre-trained Noiseprint++ model. By employing a frozen Vision Transformer to extract multi-scale features and applying unsupervised K-Means clustering, the approach effectively distinguishes real from synthetic images with minimal reliance on labeled data. The method achieves an average accuracy of 82.2% across four benchmark datasets, demonstrating superior generalization, particularly for diffusion-based synthetic images, compared to existing state-of-the-art detectors.
Achieving 82.2% accuracy in synthetic image detection without any training sets a new standard for efficiency and effectiveness in the field.
The rapid advancement of generative artificial intelligence (AI) has made synthetic images remarkably realistic, posing security threats such as misinformation and fraud. It is significant to detect the synthetic image in the manner of passive and blind image authentication. Most existing detectors rely on supervised training with large labeled datasets, leading to high costs and degraded performance on unknown generative models. To attenuate such deficiencies, we propose a training-free detection method. Specifically, noise residual fingerprints are first extracted by a simple yet effective pre-trained Noiseprint++ model. Then multi-scale features are further extracted from such residual by a frozen Vision Transformer (ViT), followed by adaptive weighted fusion. Only a few real image samples are used needed to initialize the clustering centers for unsupervised K-Means, distinguishing real and synthetic images without training. Extensive evaluations on four benchmark datasets show that our proposed scheme achieves an average accuracy of 82.2%, outperforming the state-of-the-art detectors on generalization ability. Superior performance is gained on the popular diffusion type of synthetic images, and the effectiveness of each module is validated by ablation studies. Source code will be publicly available at https://github.com/multimediaFor/NoiseCluSID.