Search papers, labs, and topics across Lattice.
To address the fragility of autoregressive coordinate generation on dense satellite imagery, this paper reformulates remote sensing temporal change localization as a candidate region selection problem. The framework couples a text-conditioned proposal module with an MLLM by encoding candidate regions into discrete tokens enriched with multi-frame spatio-temporal features, turning spatial localization into a token selection task. This paradigm significantly outperforms coordinate-token baselines on temporal change localization and single-image visual grounding while preserving general multimodal understanding.
Autoregressive coordinate generation fundamentally breaks down on dense satellite imagery, but framing change localization as LLM selection over discrete candidate region tokens solves this bottleneck.
Remote sensing multimodal large language models (RS-MLLMs) have advanced scene understanding and visual question answering over satellite imagery, yet localizing specific objects or changed regions remains challenging. Existing approaches rely on generating bounding box coordinates as token sequences, which is fragile for the small, densely packed objects common in remote sensing and increasingly error-prone when multiple targets must be localized simultaneously. In this work, we present an RS-specific formulation of the region selection paradigm, previously explored in natural-image MLLMs, and extend it to temporal change localization over multi-image sequences. Our framework employs a text-conditioned region proposal module, encodes each candidate as special tokens carrying per-frame visual features enriched with spatial and temporal cues, and lets the LLM localize targets by selecting region tokens in its response. We construct a multi-task training and evaluation suite spanning localization, referring expression, visual grounding, and understanding tasks across single-image and multi-temporal settings. Experiments show that our approach substantially outperforms coordinate-generation baselines on temporal change localization, while improving single-image visual grounding and maintaining competitive understanding performance. Oracle analysis decomposes the contributions of the region proposer and the LLM selector, providing diagnostic insight unique to this framework. Our code will be available at https://github.com/juwan-kr/RS-RegionSelect.
