Search papers, labs, and topics across Lattice.
This paper addresses the challenge of pixel-level image tampering detection in modern vision-language models (VLMs) by proposing a domain-generalized training framework that enhances robustness across diverse manipulation distributions. The authors implement a balanced minibatch sampling strategy to prevent optimization bias and a late-injection technique that allows for effective adaptation to new VLM-generated data without overfitting. The proposed approach achieves significant improvements over the previous state-of-the-art, with relative gains of 26.1% and 26.8% in average gIoU and cIoU metrics, respectively, across various out-of-distribution VLMs.
A simple training framework boosts pixel-level tampering detection performance in VLMs by over 26%, showcasing the power of balanced sampling and late-injection strategies.
Modern vision-language models (VLMs) have significantly improved image generation and editing capabilities, making pixel-level image tampering detection increasingly important yet challenging under cross-model and out-of-distribution shifts. This work studies domain generalization for pixel-level image tampering detection in modern VLMs like ChatGPT, Gemini, Qwen-Image, etc., aiming to learn tampering localization models that remain robust across diverse VLM-generated manipulation distributions. We propose a simple yet effective domain-generalized training framework built on two practical strategies. First, we introduce a balanced minibatch sampling scheme that strategically samples tampered and real images in each minibatch, preventing biased optimization toward either manipulated artifacts or clean-image priors and avoiding training collapse, ensuring that each optimization step receives proper sampled gradient signals. Second, we adopt a simple late-injection strategy, where the detector is first trained on large-scale base data until stable convergence, and then exposed to a small amount of newly selected supporting data from emerging VLM distributions, improving adaptability without overfitting to limited new domains. Together, these components provide a simple yet strong recipe for improving pixel-level tampering localization and OOD robustness across modern VLMs. Despite the conceptual simplicity, our framework outperforms the prior state-of-the-art PIXAR by a large margin of 26.1% and 26.8% relative improvement in average gIoU and cIoU, respectively, across OOD VLMs of GPT-Images-2.0, Gemini-3.1, FLUX.2, and Seedream 4.5. Our code is available at https://github.com/VILA-Lab/PIXAR-DG
