Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces LoMa, a local feature matching approach that leverages large-scale, diverse data mixtures, modern training techniques, and increased model capacity. By training on a significantly expanded dataset and employing enhanced training recipes, LoMa achieves substantial performance gains across various benchmarks. The authors also introduce HardMatch, a new challenging dataset with manually annotated ground truth correspondences, designed to address the limitations of existing benchmarks.
LoMa shatters performance ceilings in local feature matching, achieving state-of-the-art results by scaling data, model size, and compute, proving that even well-trodden areas can yield surprising gains with modern techniques.
Local feature matching has long been a fundamental component of 3D vision systems such as Structure-from-Motion (SfM), yet progress has lagged behind the rapid advances of modern data-driven approaches. The newer approaches, such as feed-forward reconstruction models, have benefited extensively from scaling dataset sizes, whereas local feature matching models are still only trained on a few mid-sized datasets. In this paper, we revisit local feature matching from a data-driven perspective. In our approach, which we call LoMa, we combine large and diverse data mixtures, modern training recipes, scaled model capacity, and scaled compute, resulting in remarkable gains in performance. Since current standard benchmarks mainly rely on collecting sparse views from successful 3D reconstructions, the evaluation of progress in feature matching has been limited to relatively easy image pairs. To address the resulting saturation of benchmarks, we collect 1000 highly challenging image pairs from internet data into a new dataset called HardMatch. Ground truth correspondences for HardMatch are obtained via manual annotation by the authors. In our extensive benchmarking suite, we find that LoMa makes outstanding progress across the board, outperforming the state-of-the-art method ALIKED+LightGlue by +18.6 mAA on HardMatch, +29.5 mAA on WxBS, +21.4 (1m, 10$^\circ$) on InLoc, +24.2 AUC on RUBIK, and +12.4 mAA on IMC 2022. We release our code and models publicly at https://github.com/davnords/LoMa.