Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces IRCHN, a comprehensive drone-view geo-localization benchmark that includes images captured under both day and night conditions, addressing the limitations of existing benchmarks that lack geographic alignment across modalities. The authors present MASTR-Net, a novel framework designed to enhance localization performance by integrating modality-adaptive feature enhancement and bidirectional selective state-space relation modeling. Experimental results show that MASTR-Net significantly outperforms current state-of-the-art methods on the IRCHN benchmark and maintains competitive results on other infrared datasets, demonstrating its effectiveness in challenging illumination scenarios.
A unified benchmark reveals that existing DVGL methods struggle with illumination variability, but MASTR-Net excels by bridging modality gaps.
Most existing drone-view geo-localization (DVGL) benchmarks contain drone imagery captured under a single illumination condition and lack geographically aligned visible drone images, infrared drone images, and satellite images from the same locations. To evaluate the generalization capability of DVGL methods under challenging illumination conditions, some methods train models on a visible benchmark and test them on an independent infrared benchmark. This protocol essentially constitutes transfer between datasets, which makes it difficult to systematically evaluate DVGL across daytime and nighttime conditions within a unified benchmark. To address this limitation, we construct IRCHN,a real-world DVGL benchmark designed for localization across different illumination conditions. IRCHN contains 26,460 images collected from 8,820 geographic locations across four representative scene categories, including farmland, coastline, forest, and urban areas. Each location provides one visible drone image, one infrared drone image, and one corresponding satellite image, which enables unified evaluation of DVGL methods across different illumination conditions and sensing modalities. We further propose the Modality-Adaptive State-Space Transport Relation Network (MASTR-Net), a DVGL framework tailored to localization under varying illumination conditions. MASTR-Net integrates modality-adaptive feature enhancement, bidirectional selective state-space relation modeling, and soft optimal transport relation alignment to jointly reduce modality gaps and view-induced structural discrepancies. Extensive experiments demonstrate that MASTR-Net outperforms existing state-of-the-art methods on IRCHN for localization under varying illumination conditions and achieves competitive performance on two infrared benchmarks, IR-VL328 and CVGL-RGBT. Code: https://github.com/SongtianhaoXu/MASTR-Net