Search papers, labs, and topics across Lattice.
This paper introduces CROSS, a novel framework for cross-view localization that enhances spatial intelligence by addressing limitations in existing methods related to 3D grounding, semantic consistency, and geometric reasoning. By integrating 3D-grounded alignment, structure-aware matching, and hypothesis ranking, CROSS enables models to maintain stable semantics and reliable structure while effectively transferring geometric knowledge across extreme viewpoint changes. Experimental results on the KITTI and VIGOR datasets demonstrate that CROSS not only achieves state-of-the-art performance in localization but also significantly improves the model's understanding of scene semantics and structure under drastic viewpoint variations.
CROSS redefines cross-view localization, enabling models to learn stable semantics and transferable geometry across extreme viewpoint changes, achieving state-of-the-art results.
Consistent cross-view understanding under extreme viewpoint changes is essential for spatial intelligence, as it enables models to recognize the same scene across extreme viewpoint gaps. Cross-view localization naturally provides a promising pathway toward this ability, as it requires a model to align ground-view imagery with geo-referenced satellite-view imagery despite drastic appearance changes to estimate camera poses. Recent visual foundation models have made this long-standing localization problem increasingly feasible by providing rich 2D representations for cross-view matching. However, we argue that cross-view localization should not be viewed merely as 2D matching or pose estimation. In this work, we revisit cross-view localization as more than pose estimation and investigate how it can help the model develop consistent cross-view understanding under extreme viewpoint changes, including stable semantics, reliable structure, and transferable geometry. We identify three key limitations of existing methods that prevent them from achieving this. They usually lack explicit 3D grounding, rely on strict point-wise matching that can weaken semantic consistency, and learn from an absolute objective that provides limited guidance for geometric reasoning. To address these limitations, we propose CROSS, a unified cross-view localization framework built upon 3D-grounded alignment, structure-aware matching, and hypothesis ranking. This formulation makes structure learning an intrinsic requirement, encourages semantic representations to remain stable, and enables the model to acquire transferable geometry. Extensive experiments on the KITTI and VIGOR datasets show that CROSS achieves state-of-the-art performance in cross-view localization. More importantly, CROSS effectively learns stable semantics, reliable structure, and transferable geometry across extremely different viewpoints.
