Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to category-level object pose estimation that addresses the limitations of current instance-level methods, particularly in generalizing to unseen objects. The method employs a symmetry-aware module for translation and size estimation, which utilizes a large vision model to accurately infer symmetry points, thereby simplifying the challenges of rotation estimation in the non-linear Sim(3) space. Additionally, a spherical large-kernel inception convolution feature fusion module effectively combines semantic and geometric features, resulting in state-of-the-art performance on benchmarks and practical applications in robotic systems.
Achieving state-of-the-art results in pose estimation, this method leverages symmetry-aware features to simplify the complexities of rotation learning in a non-linear space.
Object pose estimation is a fundamental problem for an agent system to perceive or manipulate objects in images or videos. However, current instance-level methods struggle with generalization to unseen objects. Category-level methods seek to address this, but remain constrained by the complexities of learning in the non-linear Sim(3) space and intra-class variations. To address these challenges, We propose an effective method for category-level object pose estimation with two key innovations: (1) A translation/size estimator, featuring a semantic-guided symmetry-aware module that leverages robust generalization capabilities of a large vision model (LVM) to infer symmetry points, resulting in accurate translation and size without shape priors. This result serves as a precomputed cue for rotation estimation, thereby reducing the difficulty of learning in the non-linear Sim(3) space and laying a robust foundation for tackling the inherently more challenging rotation estimation. (2) A feature fusion module, based on our proposed spherical large-kernel inception convolution, fuses semantic features from the LVM with systematically computed geometric features to extract essential pose features from intra-class variations by modeling long-range dependencies without excessive computational cost. Built on these innovations, we achieve SOTA on benchmarks and real-world scenes, while developing a robust robotic picking system capable of handling diverse objects. Our code will be available at the project page: {\hypersetup{urlcolor=blue}https://panfei-cheng.github.io/SSH-Pose}.
