Search papers, labs, and topics across Lattice.
This paper introduces Frequency-Aware Semantic Alignment (FASA), a novel framework for image manipulation localization (IML) designed to detect both traditional and diffusion-generated edits. FASA bridges the micro-macro gap by extracting manipulation-sensitive frequency cues using an adaptive dual-band DCT module and learning manipulation-aware semantic priors via patch-level contrastive alignment on frozen CLIP representations. The framework then injects these priors into a hierarchical frequency pathway using a semantic-frequency side adapter and employs a prototype-guided, frequency-gated mask decoder to predict tampered regions.
Achieve state-of-the-art image manipulation localization by unifying low-level frequency cues and high-level semantic priors, enabling robust detection of both traditional and diffusion-generated edits.
As generative image editing advances, image manipulation localization (IML) must handle both traditional manipulations with conspicuous forensic artifacts and diffusion-generated edits that appear locally realistic. Existing methods typically rely on either low-level forensic cues or high-level semantics alone, leading to a fundamental micro--macro gap. To bridge this gap, we propose FASA, a unified framework for localizing both traditional and diffusion-generated manipulations. Specifically, we extract manipulation-sensitive frequency cues through an adaptive dual-band DCT module and learn manipulation-aware semantic priors via patch-level contrastive alignment on frozen CLIP representations. We then inject these priors into a hierarchical frequency pathway through a semantic-frequency side adapter for multi-scale feature interaction, and employ a prototype-guided, frequency-gated mask decoder to integrate semantic consistency with boundary-aware localization for tampered region prediction. Extensive experiments on OpenSDI and multiple traditional manipulation benchmarks demonstrate state-of-the-art localization performance, strong cross-generator and cross-dataset generalization, and robust performance under common image degradations.
