Search papers, labs, and topics across Lattice.
The paper introduces TAX-DPD, a hierarchical, disentangled point diffusion framework for precise object placement in robotic manipulation. It uses a feed-forward Dense Gaussian Mixture Model (GMM) to predict global scene-level placements, followed by a disentangled point cloud diffusion module for local object-level configuration, separating object geometry and placement frame diffusion. TAX-DPD achieves state-of-the-art performance in placement precision, multi-modal coverage, and generalization, even outperforming SE(3)-diffusion methods for rigid object placement.
Disentangling object geometry from placement frame diffusion yields surprisingly high accuracy in robotic manipulation, even surpassing SE(3)-diffusion methods.
Recent advances in robotic manipulation have highlighted the effectiveness of learning from demonstration. However, while end-to-end policies excel in expressivity and flexibility, they struggle both in generalizing to novel object geometries and in attaining a high degree of precision. An alternative, object-centric approach frames the task as predicting the placement pose of the target object, providing a modular decomposition of the problem. Building on this goal-prediction paradigm, we propose TAX-DPD, a hierarchical, disentangled point diffusion framework that achieves state-of-the-art performance in placement precision, multi-modal coverage, and generalization to variations in object geometries and scene configurations. We model global scene-level placements through a novel feed-forward Dense Gaussian Mixture Model (GMM) that yields a spatially dense prior over global placements; we then model the local object-level configuration through a novel disentangled point cloud diffusion module that separately diffuses the object geometry and the placement frame, enabling precise local geometric reasoning. Interestingly, we demonstrate that our point cloud diffusion achieves substantially higher accuracy than a prior approach based on SE(3)-diffusion, even in the context of rigid object placement. We validate our approach across a suite of challenging tasks in simulation and in the real-world on high-precision industrial insertion tasks. Furthermore, we present results on a cloth-hanging task in simulation, indicating that our framework can further relax assumptions on object rigidity.
CMU ML