Search papers, labs, and topics across Lattice.
This paper introduces LabDex, a comprehensive benchmark designed to evaluate dexterous manipulation in chemistry laboratories, addressing the limitations of existing benchmarks that fail to integrate real-world interactions and multi-stage procedures. LabDex features a hierarchical task taxonomy that categorizes skills into Atomic Skills, Compositional Skills, and Long-Horizon Workflows, facilitating systematic training and evaluation of robotic policies. Experimental results confirm that LabDex effectively supports the assessment of robotic learning methods across various levels of laboratory tasks, paving the way for advancements in autonomous laboratory robotics.
LabDex reveals how a structured approach to task taxonomy can enhance the training and evaluation of robots in complex laboratory settings.
Autonomous laboratories hold great promise for accelerating scientific discovery. To achieve this vision, robots are supposed to dexterously manipulate diverse labware and instruments and execute long-horizon, state-dependent experimental procedures. Yet existing benchmarks do not jointly capture dexterous hand use, real-world laboratory interactions, and multi-stage experimental procedures, limiting systematic training and evaluation. To bridge this gap, we introduce LabDex, a large-scale real-world dataset and benchmark for dexterous manipulation in chemistry laboratories, organized around a hierarchical task taxonomy spanning atomic skills, compositional tasks, and long-horizon experiments. First, LabDex is cross-platform and, for the first time, unifies real-world and simulation platforms under a common framework, providing standardized task definitions, demonstrations, and evaluation protocols. Second, LabDex is large-scale and systematically organizes chemistry laboratory operations into three interconnected levels: Atomic Skills, which characterize fundamental dexterous manipulation capabilities; Compositional Skills; and Long-Horizon Laboratory Workflows. This hierarchical design not only supports the evaluation of end-task performance, but also enables the analysis of how fundamental dexterous skills compose and influence more complex laboratory operations. We conduct cross-level evaluations of representative robot learning methods in both real-world and simulation environments. The experimental results validate the effectiveness of the LabDex task design and demonstration data, and show that the benchmark supports the training and systematic evaluation of existing robotic policies across laboratory dexterous manipulation tasks at different levels, providing a foundation for further research and development of autonomous laboratory robots.
