Search papers, labs, and topics across Lattice.
This paper introduces novel constraints for joint estimation of absolute pose and focal length by integrating gravity vectors from IMU data with local geometric information from feature descriptors. The proposed solvers, UP1PfAC and UP2PfORI, significantly reduce the number of required correspondences from four to one or two, respectively, enhancing computational efficiency and robustness in pose estimation. Evaluations on large-scale datasets show that these methods outperform state-of-the-art techniques in both speed and accuracy for localization tasks.
Achieving accurate pose estimation with just one or two feature correspondences could revolutionize localization in consumer devices.
Inertial measurement units (IMUs) are now standard in most consumer devices, such as smartphones, drones, and extended reality (XR) headsets. By fusing visual and inertial data, localization systems gain significantly in speed and robustness compared to vision-only or IMU-only approaches. However, traditional pose estimation methods fail to utilize the local geometric information embedded in feature descriptors like SIFT. Recent work has proved the advantages of leveraging this information for relative and absolute pose estimation, but its application to partially calibrated absolute pose estimation remains unexplored. In this paper, we derive novel constraints for joint estimation of absolute pose and focal length, making use of a gravity vector obtained from IMU data and the feature-induced local geometry, which we use to construct two efficient solvers: UP1PfAC, that operates given a single affine correspondence and UP2PfORI, which requires two orientation-covariant features. Unlike traditional, semi-calibrated absolute pose methods requiring four point correspondences, our solvers benefit from fewer samples and lower computational cost, simplifying robust estimation in modern RANSAC-like frameworks. We evaluate the proposed solvers against the state-of-the-art on large-scale public datasets and demonstrate that our method achieves fast and accurate localization and focal length estimation.
