Search papers, labs, and topics across Lattice.
The paper introduces HiMix, a novel framework for Synthetic Image Detection (SID) designed to improve generalization to unseen generators. HiMix employs a Mixup-driven Distributional Augmentation (MDA) module to create transitional real/fake samples and a Hierarchical Artifact-aware Representation (HAR) module to aggregate global and local artifact information. Experiments show HiMix achieves state-of-the-art performance and better logit separation, indicating improved generalization.
Existing synthetic image detectors fail to generalize to new generators, but HiMix closes the gap by learning artifact-aware representations across diverse distributions.
The rapid evolution of generative models has enabled the creation of highly realistic and diverse synthetic images, posing significant challenges to reliable and generalizable Synthetic Image Detection (SID). However, existing detectors are typically trained on limited and biased datasets, resulting in poor generalization to unseen generators. To address this issue, we propose HiMix, a unified framework that enhances generalization by expanding the training distribution and promoting artifact-aware representations. Specifically, the Mixup-driven Distributional Augmentation (MDA) module constructs continuous transitional samples between real and fake images, improving coverage of low-confidence regions and exposing the model to more challenging samples, while the pixel-wise mixup operation smoothly perturbs semantics to enhance sensitivity to low-level artifacts. Moreover, the Hierarchical Artifact-aware Representation (HAR) module aggregates artifact information from both global and local levels through cross-layer integration and coarse-to-fine feature fusion, enabling the extraction of discriminative forgery representations under diverse distributions. Extensive experiments across multiple benchmarks demonstrate that HiMix achieves state-of-the-art performance, establishing well-separated logits for improved generalization to unseen forgeries.