Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
This paper introduces Uni-PNP, a unified policy that jointly learns prehensile and non-prehensile manipulation for object pose reaching, overcoming the limitations of sequential primitive integration. By pretraining a geometry encoder on contact-dynamics data and employing a two-stage RL curriculum, Uni-PNP successfully integrates diverse object and gripper geometries. The approach achieves state-of-the-art performance, demonstrating significant gains on both seen and unseen objects, and exhibits emergent complex manipulation behaviors.
A single policy now masters both pushing and grasping, achieving 57.91% success on unseen objects and enabling complex emergent behaviors like table-assisted reorientation during grasping.
Object manipulation often requires combining non-prehensile actions with grasping. However, existing approaches typically develop these capabilities separately and integrate them by sequencing distinct primitives through prescribed intermediate objectives, limiting the coordination of contact motions and grasping. Their integration also remains sensitive to object and gripper geometry and depends on particular environmental supports, complicating real-world deployment. We present Uni-PNP, a unified policy that jointly learns prehensile and non-prehensile manipulation for object pose reaching across diverse objects and grippers. To achieve this, we first pretrain a geometry encoder to predict contact-induced object motion using a contact-dynamics dataset constructed from simulated interactions between diverse objects and grippers. We then train the policy in a two-stage reinforcement learning curriculum from graspable objects to ungraspable peers, encouraging the discovery of non-prehensile interactions and their integration with grasping. Experiments show 76.39% success on hundreds of seen objects with grippers, and 57.91% on unseen peers, outperforming the strongest pose-reaching baseline by 20.52 and 17.79 percentage points, respectively. We also analyze emergent behaviors, including nonprehensile and prehensile repositioning, grasp acquisition that requires grasping after tipping, and table-assisted reorientation while grasping, and transfer to the real-world scenario. Project page available at lgswdn.github.io/Uni-PNP.