Search papers, labs, and topics across Lattice.
The GraspIT dataset bridges the gap between simulation and real-world applications in robotic grasping by providing photorealistic RGB-D observations and physically validated grasp quality annotations. Utilizing a four-stage physical slip-test on Franka Panda robots, the dataset evaluates approximately 2.3 million grasp candidates, yielding an 83% success rate for good grasps and generating graded hard negatives for improved training. This comprehensive resource includes 316k annotated RGB-D frame sets across simulated and real environments, facilitating advancements in manipulation policy learning and behavior cloning.
83% of grasp candidates in the GraspIT dataset are validated as good, providing a rich resource for training robust robotic grasping systems.
Robust robotic grasping of novel objects requires datasets that simultaneously provide photorealistic RGB-D observations, physically validated grasp quality annotations, and a principled bridge between simulation and the real world, which existing datasets lack to provide jointly. \textbf{GraspIT} addresses this gap: tabletop scenes in NVIDIA Isaac Sim are annotated via a four-stage physical slip-test on parallel Franka Panda instances, producing trajectory-reachability checks and continuous quality scores beyond force-closure.Of ${\sim}$2.3M candidates, 83% pass as \emph{good} ($s{\geq}0.50$); the 17% that passed force-closure but failed the slip-test provide graded hard negatives. A Real$\leftrightarrow$Sim loop back-projects these labels onto 100 real-world scenes. The release provides ${\sim}$316k annotated RGBD frame sets across 1035 sim and 100 real scenes, with instance masks, 6-DoF poses, physical object properties, and scored 6-DoF grasps. All tools are open-source and Docker-containerized. The trajectory planning within Isaac Sim further allows streaming of high resolution demonstrations for tabletop manipulation policy learning and behavior cloning.
