Search papers, labs, and topics across Lattice.
This paper investigates the reliability of pose estimation by examining the spatial relationships between predicted keypoints, addressing the common oversight of rotational consistency in keypoint-based methods. By introducing a set of geometric features that quantify self-consistency among keypoints, the authors demonstrate that a logistic regression classifier can effectively identify failures in pose estimation. The key result shows that this approach outperforms traditional confidence-based methods, highlighting the importance of geometric relationships in enhancing pose estimation accuracy.
Keypoint self-consistency can reveal pose estimation failures that traditional confidence measures miss, leading to more reliable 3D object localization.
One common approach to pose estimation involves predicting object keypoints in an image, followed by using Perspective-n-Point algorithms to compute the object's rotation and translation relative to the camera. While rotations preserve object shapes, this property is often neglected in keypoint-based pose estimation methods, where keypoints are typically predicted independently from each other. As imprecise keypoint predictions negatively affects pose estimation accuracy, it also limits its reliability in downstream tasks. In this work, we explore whether such inaccurate pose estimates can be identified by simply examining spatial locations between 2D keypoints. We propose a set of hand-crafted geometric features that capture the self-consistency of keypoint predictions, including pairwise distances, reprojection consistency, as well as render and mask consistency. Despite its simplicity, a logistic regression classifier trained on these features reliably detects pose estimation failures, outperforming confidence-based approaches like conformal keypoint predictions that rely solely on keypoint uncertainty.
