Search papers, labs, and topics across Lattice.
MG-Grasp is introduced as a novel depth-free 6-DoF grasping framework that reconstructs metric-scale, multi-view consistent dense point clouds from sparse RGB images using a two-view 3D foundation model. This reconstruction, informed by camera intrinsics/extrinsics, enables the generation of stable 6-DoF grasps suitable for reliable robotic manipulation. Experiments on GraspNet-1Billion and in the real world demonstrate state-of-the-art grasp performance among RGB-based 6-DoF grasping methods.
You can now achieve state-of-the-art 6-DoF robotic grasping using only sparse RGB images, rivaling depth-based methods.
Single-view RGB-D grasp detection remains a com- mon choice in 6-DoF robotic grasping systems, which typically requires a depth sensor. While RGB-only 6-DoF grasp methods has been studied recently, their inaccurate geometric repre- sentation is not directly suitable for physically reliable robotic manipulation, thereby hindering reliable grasp generation. To address these limitations, we propose MG-Grasp, a novel depth- free 6-DoF grasping framework that achieves high-quality object grasping. Leveraging two-view 3D foundation model with camera intrinsic/extrinsic, our method reconstructs metric- scale and multi-view consistent dense point clouds from sparse RGB images and generates stable 6-DoF grasp. Experiments on GraspNet-1Billion dataset and real world demonstrate that MG-Grasp achieves state-of-the-art (SOTA) grasp performance among RGB-based 6-DoF grasping methods.
Tsinghua AI