Search papers, labs, and topics across Lattice.
This paper addresses the issue of landmark bias in geo-localization by introducing HoloGeo, an evidence-driven reasoning framework designed to enhance the reliability of Vision-Language Models (VLMs). The authors establish two quantitative metrics, Bias Intensity (BI) and Bias Harmfulness (BH), alongside a new benchmark dataset, LandmarkBias-3K, to systematically evaluate the impact of landmark bias on model performance. Experimental results show that HoloGeo not only excels on standard datasets like IM2GPS3K and YFCC4k but also significantly outperforms existing VLMs on the LandmarkBias-3K benchmark, demonstrating its effectiveness in promoting robust geospatial reasoning.
Landmark bias can lead to significant inaccuracies in geo-localization, but HoloGeo effectively mitigates this issue through evidence-driven reasoning, outperforming existing models.
Recent advances in Vision-Language Models (VLMs) have significantly improved image geo-localization, yet existing models remain susceptible to landmark bias, causing them to overlook geographical cues or form spurious correlations, ultimately resulting in inaccurate localization. To systematically investigate this issue, we first design two quantitative metrics, Bias Intensity (BI) and Bias Harmfulness (BH), to characterize the impact of landmarks exerted on model reasoning, and establish a comprehensive benchmark, LandmarkBias-3K. To mitigate landmark bias, we further propose an evidence-driven reasoning framework, HoloGeo, to improve the reliability of geo-localization. HoloGeo is supported by a high-quality dataset, BF-30k, annotated with structured multi-evidence bias-free reasoning chains. By incorporating multi-dimensional rewards, HoloGeo explicitly encourages balanced attention over diverse visual cues and achieves evidence-driven joint reasoning. Extensive experiments demonstrate that HoloGeo not only maintains excellent performance on IM2GPS3K and YFCC4k but also significantly outperforms existing open-source VLMs on LandmarkBias-3K, validating its effectiveness for robust geospatial reasoning.
NUS