Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces a reinforcement learning framework for robotic grasp refinement that combines keypoint-based object representations with a Deep Q-Network (DQN). By generating initial grasp candidates through a geometric algorithm and iteratively refining them, the framework transforms previously unsuccessful grasps into successful ones, achieving a remarkable 100% success rate on objects previously deemed ungraspable. The approach's effectiveness is further validated through successful physical experiments, demonstrating its potential for real-world applications in contact-rich manipulation tasks.
Reinforcement learning can turn failed robotic grasps into successes, achieving a 100% success rate on previously ungraspable objects.
Developing robots capable of understanding and manipulating objects requires compact, interpretable, and generalizable representations. This work proposes a reinforcement learning-based framework for robotic grasp refinement, integrating keypoint-based object representations with a Deep Q-Network (DQN). Using 2D overhead images captured in a simulated environment, a geometric-based algorithm generates initial grasp candidates, which are iteratively refined by the proposed framework, transforming failed grasps into successful ones. Experiments conducted on 300 objects from the Dex-Net dataset using a UR5 manipulator demonstrate the framework's effectiveness, achieving a 100% success rate on objects previously deemed ungraspable by geometrical methods. The framework's sim-to-real transferability is further validated through physical experiments on a Delta parallel robot, where a refined grasp successfully manipulates an object that was previously ungraspable. The findings underscore the effectiveness of reinforcement learning in addressing challenges in robotic grasping, offering a scalable and adaptable solution for contact-rich manipulation tasks.