Search papers, labs, and topics across Lattice.
This paper addresses the challenge of dexterous manipulation in industrial automation by introducing the Industrial Dexterity Benchmark (IDB) platform, which simulates real-world tasks like cable routing and assembly. The authors developed a multimodal imitation-learning framework, DAG-ROS, and a novel policy framework, AG-iDP3, which integrates various sensory inputs to enhance robotic performance. Notably, their best-performing multimodal expansion Diffusion Policy achieved a 78% success rate in a cable manipulation task, significantly outperforming the 36% success rate of a traditional single-camera approach, highlighting the potential for improved automation in industrial settings.
A multimodal diffusion policy outperforms traditional methods, achieving a 78% success rate in industrial cable manipulation tasks, demonstrating a leap in automation capabilities.
Dexterous manipulation remains a critical bottleneck in industrial automation; tasks such as cable routing, connector insertion, and precision assembly still rely heavily on manual labor despite decades of robotics research. This work presents a progression from classical, modular robotics pipelines toward an end-to-end multimodal imitation-learning framework for industrial dexterous manipulation. As a part of this work, we introduce three key contributions: a set of Industrial Dexterity Benchmark (IDB) boards aimed to mimic datacenter cable management, automotive cable harnesses, and gearbox assembly tasks; a scalable imitation learning framework (DAG-ROS); and a multimodal diffusion-based policy framework (AG-iDP3) that creates models fusing RGB images, point clouds, joint positions, and wrist-frame wrench data. Focusing on the datacenter cable manipulation board, we evaluate the performance of a task involving cleaning a single cable over variations of an end-to-end AI policy using 48 trials per configuration. The best performing configuration, a multimodal expansion Diffusion Policy (DP), includes a multi-view RGB image source passed through an R3M encoder and reaches a 78% grasp and insert combined task success rate. This performance marks a significant improvement over the 36% observed from the single-camera RGB DP baseline. Each of the tested configurations requires only approximately 100 teleoperated demonstrations per task phase. These results indicate that the correct learned policy can outperform classical vision and control robotic methods in robustness, generalization, and deployment efficiency, justifying a shift toward scalable robotic automation for high up-time industrial environments.
