Search papers, labs, and topics across Lattice.
The paper introduces Spatially-Weighted CLIP (SW-CLIP) for street-view geo-localization, which incorporates spatial autocorrelation by using distance-aware soft supervision during contrastive learning. SW-CLIP encodes geographic positions as text and replaces one-hot InfoNCE targets with spatially weighted soft labels derived from geodesic distance, along with a neighborhood-consistency regularization term. Experiments on a multi-city dataset show SW-CLIP significantly improves geo-localization accuracy and spatial coherence compared to standard CLIP.
Ignoring geography's core principle that "nearby things are more related" cripples CLIP's ability to understand location, but this simple fix unlocks substantial gains in geo-localization accuracy.
This paper proposes Spatially-Weighted CLIP (SW-CLIP), a novel framework for street-view geo-localization that explicitly incorporates spatial autocorrelation into vision-language contrastive learning. Unlike conventional CLIP-based methods that treat all non-matching samples as equally negative, SW-CLIP leverages Tobler's First Law of Geography to model geographic relationships through distance-aware soft supervision. Specifically, we introduce a location-as-text representation to encode geographic positions and replace one-hot InfoNCE targets with spatially weighted soft labels derived from geodesic distance. Additionally, a neighborhood-consistency regularization is employed to preserve local spatial structure in the embedding space. Experiments on a multi-city dataset demonstrate that SW-CLIP significantly improves geo-localization accuracy, reduces long-tail errors, and enhances spatial coherence compared to standard CLIP. The results highlight the importance of shifting from semantic alignment to geographic alignment for robust geo-localization and provide a general paradigm for integrating spatial principles into multimodal representation learning.
