Search papers, labs, and topics across Lattice.
This paper introduces a unified single-stage framework for cross-view object geo-localization (CVOGL) that leverages a new large-scale dataset, \dataset, containing over 220,000 ground-satellite and drone-satellite pairs with diverse prompts and camera poses. The proposed Geometry-Aware Geo-localization framework (GAGeo) utilizes a permutation-equivariant 3D foundation model to integrate visual features and referring prompts, allowing for simultaneous predictions of bounding boxes, segmentation masks, and camera poses. Experimental results show that GAGeo significantly outperforms existing methods, demonstrating strong generalization in unseen environments and novel cross-view scenarios.
A novel framework enables zero-shot localization across ground and drone views, outperforming traditional methods by leveraging a rich dataset and advanced geometric modeling.
Cross-view object geo-localization (CVOGL) aims to locate a target object from a query view (e.g., ground or drone) within a geo-tagged reference image (e.g., satellite). Existing approaches heavily rely on 2D appearance matching and are constrained by limited datasets lacking geometric metadata, diverse prompts, and standard field-of-view imagery. To address these intertwined challenges, we first introduce \dataset, a large-scale, high-fidelity building dataset comprising over 220,000 ground-satellite and drone-satellite pairs. It provides multi-modal prompts (points, boxes, masks) and camera poses to enable flexible target referring and explicit spatial modeling. Furthermore, we propose a novel single-stage Geometry-Aware Geo-localization framework (GAGeo), built upon the permutation-equivariant 3D foundation model $蟺^3$. By seamlessly integrating visual features, referring prompts, and learnable task tokens, our model adapts the inherited 3D prior to jointly predict bounding boxes, segmentation masks, and camera poses in a single forward pass. Additionally, we introduce a contrastive loss that utilizes the satellite view as a universal anchor, implicitly aligning ground and drone representations to enable zero-shot ground-to-drone localization without requiring triplet training data. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods, exhibiting exceptional generalization ability in unseen scenes and novel cross-view setups.
