Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces GeoEyes, a staged training framework to improve the ability of multimodal large language models (MLLMs) to actively explore ultra-high-resolution (UHR) remote sensing imagery using zoom-in tools. GeoEyes addresses the problem of "Tool Usage Homogenization" in existing zoom-enabled MLLMs by using a cold-start SFT dataset (UHR-CoZ) and an agentic reinforcement learning method (AdaZoom-GRPO) that rewards evidence gain and answer improvement. Experiments on UHR remote sensing benchmarks demonstrate that GeoEyes learns on-demand zooming with proper stopping behavior, achieving a 54.23% accuracy on XLRS-Bench.
MLLMs struggle to effectively zoom into relevant details in ultra-high-resolution remote sensing imagery, but a new staged training framework can teach them when and where to focus for substantial accuracy gains.
The "thinking-with-images" paradigm enables multimodal large language models (MLLMs) to actively explore visual scenes via zoom-in tools. This is essential for ultra-high-resolution (UHR) remote sensing VQA, where task-relevant cues are sparse and tiny. However, we observe a consistent failure mode in existing zoom-enabled MLLMs: Tool Usage Homogenization, where tool calls collapse into task-agnostic patterns, limiting effective evidence acquisition. To address this, we propose GeoEyes, a staged training framework consisting of (1) a cold-start SFT dataset, UHR Chain-of-Zoom (UHR-CoZ), which covers diverse zooming regimes, and (2) an agentic reinforcement learning method, AdaZoom-GRPO, that explicitly rewards evidence gain and answer improvement during zoom interactions. The resulting model learns on-demand zooming with proper stopping behavior and achieves substantial improvements on UHR remote sensing benchmarks, with 54.23% accuracy on XLRS-Bench.