Search papers, labs, and topics across Lattice.
This paper introduces a vision-based framework for safe humanoid motion imitation that uses a single camera to capture human skeletal keypoints and retarget them to the robot. A Control Barrier Function (CBF) is formulated as a Quadratic Program (QP) to filter imitation commands, ensuring both self-collision avoidance and human-robot collision avoidance. Simulation results demonstrate the framework's effectiveness for real-time, collision-aware motion imitation.
Humanoid robots can now safely mimic your moves in real-time, thanks to a vision-based safety net that prevents them from bumping into you (or themselves).
Ensuring operational safety is critical for human-to-humanoid motion imitation. This paper presents a vision-based framework that enables a humanoid robot to imitate human movements while avoiding collisions. Human skeletal keypoints are captured by a single camera and converted into joint angles for motion retargeting. Safety is enforced through a Control Barrier Function (CBF) layer formulated as a Quadratic Program (QP), which filters imitation commands to prevent both self-collisions and human-robot collisions. Simulation results validate the effectiveness of the proposed framework for real-time collision-aware motion imitation.
