Search papers, labs, and topics across Lattice.
This paper introduces RS-RIE-Bench, the first benchmark specifically designed for reasoning-guided remote sensing image editing, addressing the inadequacies of existing benchmarks that focus on natural images. The benchmark categorizes tasks into temporal, causal, and spatial reasoning, evaluating models on target region plausibility, non-target region preservation, and image quality consistency. Systematic evaluations reveal that even the best-performing models struggle significantly, achieving only 24.28% accuracy under strict criteria, highlighting critical limitations in geographic reasoning and sensor consistency in current image editing approaches.
Current models falter in reasoning-guided remote sensing image editing, with the best achieving only 24.28% accuracy, exposing a critical gap in AI capabilities.
Remote sensing image editing aims to modify remote sensing images according to natural language instructions while preserving geographic rules and sensor observation characteristics. Existing benchmarks mainly target natural images or general visual scenes, and thus may not fully capture the reasoning, regional control, and sensor-consistency abilities required in remote sensing editing. To fill this gap, we introduce RS-RIE-Bench, the first benchmark for reasoning-guided remote sensing image editing. RS-RIE-Bench organizes tasks into three categories: temporal reasoning, causal reasoning, and spatial reasoning. These categories capture temporal evolution, causal consequence, and spatial imaging consistency in remote sensing scenes. The evaluation protocol covers three dimensions: target region plausibility, non-target region preservation, and image quality consistency. We further demonstrate the feasibility of MLLM-based evaluation through cross-judge consistency analysis and stratified expert review. Systematic evaluation on eight open-source and closed-source image editing models shows that current models still have clear limitations in reasoning-guided remote sensing editing. Even the strongest model achieves only 24.28\% overall accuracy under the strict joint-satisfaction criterion, while the mean relaxed joint-4 success rate across all eight models is 32.23\%. Causal reasoning and spatial reasoning remain especially challenging, and several open-source models are close to zero in some categories. These results show that RS-RIE-Bench can effectively reveal the limitations of current models in geographic reasoning, regional control, and sensor-consistent generation. It also provides a standardized benchmark and a clear research direction for future remote sensing intelligent editing models.
