Search papers, labs, and topics across Lattice.
This paper introduces Flow6D, a hierarchical flow matching framework designed to enhance category-level 6D pose estimation by addressing the challenges of accuracy and efficiency in high-dimensional continuous space. By discretizing rotation and translation parameters into bins, Flow6D utilizes a two-stage approach that first localizes poses in a discrete latent space before refining them through continuous flow matching to optimize estimates. The method significantly outperforms existing techniques on both synthetic and real datasets, achieving real-time inference at 70 FPS, making it suitable for applications in robotic manipulation and augmented reality.
Flow6D achieves real-time 6D pose estimation with unprecedented accuracy by combining discrete localization with continuous refinement, outperforming state-of-the-art methods.
6D pose estimation is a key task in computer vision and embodied AI, widely used in robotic manipulation, augmented reality, etc. Existing methods directly regress in a high-dimensional continuous space, facing two key challenges in category-level pose estimation: limited accuracy due to noise and local optima, and inefficient search over an infinite space that hinders real-time performance. This paper proposes Flow6D, a hierarchical flow matching framework with a two-stage discrete latent space localization-continuous pose regression strategy. Rotation and translation parameters are first discretized into bins, with a discrete flow matching model locking the latent space around the true pose to reduce search complexity. Then, by sampling in the latent space, a continuous flow matching model predicts local pose residuals to optimize the estimate and regress to an accurate pose. The framework also naturally extends to articulated objects, outperforming state-of-the-art methods on synthetic and real datasets with real-time inference at 70 FPS. Project website: https://flow6d.github.io/.
