Search papers, labs, and topics across Lattice.
HRDexDB, a new large-scale dataset, provides synchronized multi-modal data of human and robotic hands grasping 100 diverse objects. The dataset contains 1.4K grasping trials with high-precision 3D motion capture, tactile signals, and multi-view video. HRDexDB enables the study of physical interaction and serves as a benchmark for cross-domain dexterous manipulation.
Finally, a dataset that directly compares human and robot hand dexterity on the same objects, capturing both successes and failures.
We present HRDexDB, a large-scale, multi-modal dataset of high-fidelity dexterous grasping sequences featuring both human and diverse robotic hands. Unlike existing datasets, HRDexDB provides a comprehensive collection of grasping trajectories across human hands and multiple robot hand embodiments, spanning 100 diverse objects. Leveraging state-of-the-art vision methods and a new dedicated multi-camera system, our HRDexDB offers high-precision spatiotemporal 3D ground-truth motion for both the agent and the manipulated object. To facilitate the study of physical interaction, HRDexDB includes high-resolution tactile signals, synchronized multi-view video, and egocentric video streams. The dataset comprises 1.4K grasping trials, encompassing both successes and failures, each enriched with visual, kinematic, and tactile modalities. By providing closely aligned captures of human dexterity and robotic execution on the same target objects under comparable grasping motions, HRDexDB serves as a foundational benchmark for multi-modal policy learning and cross-domain dexterous manipulation.
