Search papers, labs, and topics across Lattice.
This study introduces a data-driven framework that generates robot hand designs from over 4 million frames of human fingertip motion, leveraging a simple control policy based on inverse kinematics. By optimizing tree-structured designs and employing reinforcement learning to propose effective configurations, the framework significantly reduces the design search time from hours to minutes. The resulting robot hands, including a versatile 6-degree-of-freedom hand, outperform existing commercial options in teleoperated tasks, demonstrating the potential of using human motion data for both control and physical embodiment in robotics.
Large-scale human motion data can not only train robot controllers but also optimize the physical designs of robot hands, achieving superior performance in real-world applications.
Robot learning has advanced rapidly in learning control, but learning the physical body of a robot remains much more difficult because jointly searching over design and control creates a very large combinatorial problem. Here, we present a data-driven framework for generating robot hands from human demonstrations. Instead of learning a complex controller together with each candidate design, we generate robot hand designs using the same simple control policy used after fabrication: matching fingertip positions through inverse kinematics. Using more than 4 million frames of human fingertip motion from everyday manipulation, our algorithm optimizes tree-structured robot hands to reproduce desired target motions. The framework produced both a 6-degree-of-freedom (DoF) general-purpose hand and lower-DoF task-specific hands with spatial four-bar mimic joints. To accelerate the search over designs, we trained a reinforcement-learning (RL) actor to propose good hand designs and joint angles, reducing search time from hours to minutes. We fabricated the mechanisms directly as one-piece articulated structures with print-in-place joints. In real-world experiments, the 6-DoF hand achieved highly accurate teleoperated fingertip tracking better than available commercial robot hands, whereas the specialized 3-DoF hands reproduced structured human and synthetic trajectories with reduced mechanical complexity. These results showed that large-scale human motion data can be used not only to train robot controllers but also as a reference for optimizing and generating the physical embodiment of robots.
Amazon Science