Search papers, labs, and topics across Lattice.
This paper addresses the challenge of monocular re-localization using OpenStreetMap (OSM) data by proposing a hierarchical search framework with semantic alignment to overcome cross-modal discrepancies and computational costs. The method leverages DINO-ViT to extract semantic information from images and establish relationships with OSM data, enabling a coarse-to-fine search strategy for efficient localization. Experiments demonstrate significant improvements in both localization accuracy and speed, achieving superior orientation recall compared to state-of-the-art methods even when trained on a single dataset.
Achieve state-of-the-art monocular re-localization in OpenStreetMap by cleverly aligning image semantics with map data, enabling faster and more accurate localization than dense matching approaches.
Monocular re-localization plays a crucial role in enabling intelligent agents to achieve human-like perception. However, traditional methods rely on dense maps, which face scalability limitations and privacy risks. OpenStreetMap (OSM), as a lightweight map that protects privacy, offers semantic and geometric information with global scalability. Nonetheless, there are still challenges in using OSM for localization: the inherent cross-modal discrepancies between natural images and OSM, as well as the high computational cost of global map-based localization. In this paper, we propose a hierarchical search framework with semantic alignment for localization in OSM. First, the semantic awareness capability of DINO-ViT is utilised to deconstruct visual elements to establish semantic relationships with OSM. Second, a coarse-to-fine search paradigm is designed to replace global dense matching, enabling efficient progressive refinement. Extensive experiments demonstrate that our method significantly improves both localization accuracy and speed. When trained on a single dataset, the 3° orientation recall of our method even outperforms the 5° recall of state-of-the-art methods.
Tsinghua AI