Search papers, labs, and topics across Lattice.
This paper introduces ForensicsTok, a novel approach that reformulates image manipulation localization as an autoregressive sequence generation task, addressing the limitations of existing multi-modal large language models (MLLMs) that rely on exogenous segmentation decoders. By employing a Token Splatting Decoder (TSD) and a Hierarchical Expert Fusion (HEF) module, ForensicsTok generates spatially grounded token sequences and integrates multi-scale features, leading to improved mask prediction and robustness against perturbations. Experimental results across six benchmarks demonstrate that ForensicsTok outperforms existing MLLM-based methods and shows competitive performance against strong forensic expert baselines.
ForensicsTok achieves unprecedented precision in image tampering localization by directly generating spatially grounded token sequences, bypassing traditional bottlenecks.
Multi-modal Large Language Models (MLLMs) offer powerful reasoning for forensic tasks, yet existing approaches utilizing exogenous segmentation decoders often suffer from suboptimal localization. The reliance on stitched pipelines introduces information bottlenecks during backpropagation, which dilutes spatial signals and is limited by semantic priors of the segmentor. To address these limitations, we propose ForensicsTok, which reformulates image manipulation localization as an autoregressive sequence generation task. ForensicsTok directly generates spatially grounded token sequences, enabling precise mask prediction without intermediary supervision. Specifically, we introduce a Token Splatting Decoder (TSD) to map tokens to binary masks via codebook-aware code smoothing, which mitigates sharp gradients from deterministic detokenizers. Furthermore, to capture diverse tampering clues, we propose a Hierarchical Expert Fusion (HEF) module that injects multi-scale features from a forensic expert model. This unified architecture effectively compensates for the lack of forensic priors in standard MLLMs. Extensive experiments on six benchmarks show that ForensicsTok substantially improves over existing MLLM-based baselines and slightly improves over strong forensic expert baselines, while exhibiting stronger robustness to perturbations.
