Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces TRAIL, a method that utilizes frozen DINO encoders to localize image edits without requiring a dedicated localizer. By analyzing patch-level perturbation responses and mapping cosine drift between patch tokens after a global Haar perturbation, TRAIL achieves competitive performance in identifying edits, with an AUROC of .903 on the CocoGlide dataset. The findings reveal that the localization capability of frozen DINO encoders is robust across various contexts, emphasizing the importance of global context in edit detection.
Patch-level responses from frozen DINO encoders can effectively localize image edits, achieving near state-of-the-art results without additional training.
Localized image edits can change a photograph's meaning while leaving most of it authentic, so forensic analysis must identify where an edit occurred. We show that patch-level perturbation responses from frozen DINO encoders are themselves localization maps. Training-free Localization of AI-image Edits from patch-token Drift (TRAIL) applies one global Haar perturbation and maps cosine drift between corresponding patch tokens. On 80 source-disjoint CocoGlide test images, TRAIL reaches .903 patch AUROC versus .912 for the mask-supervised Detective SAM; fixed-threshold Dice is .619 versus .709, while an oracle threshold raises TRAIL to .790. Transferred unchanged to Poisson image interpolation, TRAIL reaches .855 AUROC versus .864, showing that the cue persists without a generator. Across sixteen DINO encoders, the best block lies at normalized depth .80-.94. Global context matters: AUROC falls from .903 globally to .857 for local-in-canvas perturbations and .735 for independently encoded crops. Frozen DINO patch tokens therefore contain a strong late-layer localization signal whose visibility depends on the perturbation and preserved context. Code: https://github.com/VishalJ99/trail-image-edit-localization.