Search papers, labs, and topics across Lattice.
This paper addresses the critical need for a benchmark dataset to evaluate satellite image manipulation and deepfake localization, which is increasingly important due to the rise of generative AI. The authors constructed a preliminary dataset comprising 60 images—30 manipulated using techniques like copy-paste splicing and diffusion model inpainting, and 30 authentic—with accompanying ground-truth masks and acquisition metadata. This dataset aims to facilitate the development and assessment of detection algorithms in the remote sensing domain, providing essential resources for researchers tackling image forensics and geospatial deepfake detection.
A new benchmark dataset reveals that existing resources for satellite image manipulation detection are inadequate, paving the way for improved localization algorithms.
Verifying the authenticity of satellite imagery has become increasingly critical given advances in generative artificial intelligence. Highly realistic synthetic imagery produced for malicious purposes (deepfakes) can have major consequences in the remote sensing domain, where this data is a fundamental source of information for science applications, planning, logistics, and monitoring. The remote sensing community lacks high-quality, fine-grained manipulation datasets suitable for training and evaluating detection and image forensics algorithms. Existing datasets are lacking and those that do exist either provide no ground truth masks for evaluating manipulation localization, or consist of entire images generated by GANs or diffusion models, which are inadequate for measuring localization performance. To address this gap, we describe a preliminary dataset construction process and prototype benchmark dataset for satellite image manipulation detection and localization. The dataset contains 60 images total, with 30 images carefully manipulated using three manipulation types including copy-paste splicing and diffusion model inpainting, and 30 authentic images. Each image is accompanied by a ground-truth mask and acquisition metadata, enabling both pixel-level localization metrics, image metadata studies, and analyses of how manipulation detection performance relates to image collection parameters. We describe the dataset construction process and present this initial release to support further research in image forensics and geospatial deepfake detection. The prototype dataset can be downloaded at https://huggingface.co/datasets/geodf/fmow-fake-small.
