Search papers, labs, and topics across Lattice.
This paper introduces a topometric framework that integrates Visual Place Recognition (VPR) with feed-forward neural 3D geometry (FF3D) models to enhance visual localization in autonomous vehicles. By combining low-dimensional image embeddings with accurate local trajectory estimates, the method achieves improved metric precision while maintaining robustness against visual appearance changes. Extensive evaluations on three benchmarks reveal significant performance gains over traditional appearance-based localization methods, highlighting the effectiveness of the proposed approach in real-world scenarios.
Integrating VPR with FF3D models boosts localization accuracy, overcoming the limitations of traditional visual methods.
Effective Visual Localization (VL) requires a map of the environment that combines compactness for efficient scalability with robustness against visual appearance changes and metric precision. Through low-dimensional image embeddings, Visual Place Recognition (VPR) is able to successfully meet the first two requirements, but its low metric accuracy makes it less suitable than standard VL approaches based on local features or neural representations. This limitation can be overcome by integrating VPR with the accurate local trajectory estimates produced by feed-forward neural 3D geometry (FF3D) models. In this paper, we address sequential appearance-based localization through a topometric framework that iteratively combines probabilistic VPR with FF3D metric pose estimation in controlled image sets. Our approach proposes an automatic offline mapping tool that models the topometric pose-appearance interaction in the different parts of the scene. This map is later employed by an online particle filter that estimates the pose from odometry and belief over places for FF3D inference, successfully incorporating neural metric estimation into probabilistic appearance-based localization. We extensively evaluate the framework on three known benchmarks, demonstrating substantial improvements over existing appearance-based methods. The modularity of our approach allows the descriptor extractor and FF3D model to remain interchangeable, and a focused analysis further shows that sequential belief can mitigate severe failures under perceptual aliasing.
