Search papers, labs, and topics across Lattice.
This paper introduces AutoDex, an automated system designed to collect real-world data for dexterous grasping by integrating perception, execution, labeling, and resetting without human intervention. The system utilizes a dense 20-camera setup to accurately localize objects and monitor collisions during robot motions, resulting in a substantial increase in throughput and the generation of a reusable database of physically labeled grasp trials. AutoDex achieves a 4.8x improvement in data collection speed compared to traditional teleoperation methods, with a marked increase in grasp success rates when validated against real-world data.
AutoDex accelerates dexterous grasping data collection by 4.8 times while significantly improving grasp success rates from simulation-only validation.
Learning robust dexterous grasping requires real-world data that records the physical outcomes of grasp attempts. Such data is hard to obtain at scale: teleoperation yields valid physical outcomes but is slow and operator-biased, while simulation-based generation is cheap and scalable but cannot certify contact validity. A natural solution is to generate candidate grasps and verify them on real hardware, but this scales only if the entire collection loop (perception, execution, labeling, and reset) runs without human intervention. We present AutoDex, an automated real-world data-collection system that closes this loop: for each candidate from a replaceable generator, it localizes the object under severe hand-object occlusion with dense 20-camera perception, executes collision-monitored robot motions, labels lift-and-hold success or failure, and actively resets the object between trials to expose additional candidates across stable poses. The result is a reusable database of physically labeled grasp trials that downstream systems can query by retrieval and feasibility filtering. Using AutoDex, we collect 3,593 grasp trials across Allegro and Inspire hands on 100 diverse objects, with synchronized multi-view observations and robot-state logs. For a matched 500-trajectory collection, AutoDex requires 10.3 h versus 49.4 h for teleoperation, yielding a 4.8x throughput improvement, and grasps retrieved from the AutoDex-validated database succeed 76% versus 34% for simulation-only validation. Code and data will be publicly released.
