Search papers, labs, and topics across Lattice.
This study investigates the mechanisms behind the effectiveness of foundation models in detecting AI-generated images, revealing that detection relies on non-semantic low-to-mid frequency discrepancies rather than semantic failures. By employing a novel analysis protocol based on DDIM inversion, the authors demonstrate that subtle traces introduced during diffusion synthesis significantly influence detector scores across semantically identical images. Additionally, a latent-space analysis indicates that diffusion models fail to replicate the full variability of real data, highlighting the unique cues leveraged by these detectors.
Foundation models exploit subtle low-to-mid frequency cues to distinguish real images from diffusion-generated ones, challenging assumptions about semantic reliance in detection.
Vision foundation models have recently emerged as powerful feature extractors for detecting AI-generated images, achieving strong generalization across generators and robustness to common image degradations. However, the reason behind their effectiveness is poorly understood. In this work, we investigate what cues are exploited by foundation-model-based detectors to distinguish real images from diffusion-generated ones. To this end, we design an ad hoc analysis protocol based on DDIM inversion. Given a real image we generate a sequence of synthetic copies by changing the depth of DDIM inversion. Even though most copies are semantically identical to the real reference, the detector score varies significantly across them due to subtle traces introduced by the diffusion synthesis, showing that its decision is not primarily driven by semantic failures. Through a frequency-swapping analysis, we further reveal that the discriminative cues exploited by the detectors are mainly localized in the low-to-mid frequency range, rather than only in the high-frequency range, as is the case for artifacts commonly associated with generative models. Finally, a latent-space analysis shows that regenerated images exhibit reduced variance and effective dimensionality, indicating that diffusion models do not fully reproduce the variability of real data. Overall, our results suggest that foundation-model-based detectors succeed by capturing non-semantic low-to-mid frequency distributional discrepancies between real and diffusion-generated images. These findings provide new insight into the robustness and generalization of such detectors and suggest directions for more interpretable forensic methods.
