Search papers, labs, and topics across Lattice.
This paper introduces AutoCompass, a novel supervision approach for training neural map matchers that effectively utilizes weak labels, specifically raw GPS data, to improve localization accuracy. By demonstrating that heading labels can be omitted and that defining a tolerance region around GPS data enhances positional precision, the authors show significant improvements in model performance. The method outperforms traditional models reliant on absolute pose labels across various driving and egocentric benchmarks, highlighting its robustness in real-world applications.
Raw GPS labels can replace noisy heading data, leading to more accurate visual localization in neural map matchers.
Neural map matchers estimate an image's 3-DoF pose relative to a 2D map. These models are trained on large-scale datasets of geo-referenced images, whose position and heading labels often contain noise that affects the trained models. To address this, we present AutoCompass, a supervision approach for training neural map matchers from inaccurate absolute pose labels. First, we show that heading labels are unnecessary: trained from raw GPS labels, models learn to predict accurate headings, automatically. Second, defining a tolerance region around raw GPS improves positional accuracy. Third, if available, our supervision uses relative poses between training images, obtained via SLAM or SfM, which provide a more accurate training signal. Across driving and egocentric benchmarks, AutoCompass consistently outperforms counterparts trained with the usual strong reliance on absolute pose labels.