Search papers, labs, and topics across Lattice.
This paper introduces GOAG, a generative model for dexterous robotic manipulation that overcomes the limitations of traditional grasp planners by leveraging the shared surface geometry between grippers and objects. By learning a compact latent representation of a gripper's contact surface distribution, GOAG can efficiently generate valid grasp configurations without needing object-specific training data. Experimental results demonstrate that GOAG achieves an average success rate of 86.93% on the MultiDex dataset, outperforming conventional methods while significantly reducing processing time.
Object-agnostic grasp planning can achieve state-of-the-art performance without the need for object-specific training data, revolutionizing how robots learn to manipulate diverse objects.
Multifingered grasping is a crucial robotic skill, but current deep-learning grasp planners often struggle to generalize to new objects because they are trained on limited, object-specific datasets. We introduce a fundamentally different approach, grounded in the observation that the gripper and the object share identical surface geometry at their mutual contact points. We propose GOAG: Generative and Object-Agnostic Grasp Planner for Dexterous Robotic Manipulation, a novel deep generative model that learns a compact latent representation of a specific gripper's contact surface distribution, enabling the efficient sampling of valid grasp configurations without relying on object-specific training data. We show that by introducing object features only at inference time, our model can effectively retrieve admissible contact areas that are compatible with the gripper's capabilities. We validate our approach through extensive experiments on established grasp protocols in both simulated and real-world scenarios, demonstrating its effectiveness with different grippers from the literature. Our method delivers state-of-the-art results on the objects from the MultiDex dataset, achieving an average success rate of 86.93%. It offers significantly faster processing when generating numerous grasps, while matching the performance of leading approaches specifically trained on this dataset. Unlike these methods, our approach does not rely on object-specific training data, highlighting the advantages of object-agnostic learning. It effectively addresses the generalization challenges faced by traditional data-driven grasp planners. Code and videos are available on our project website https://cea-list.github.io/goagweb/ .