Search papers, labs, and topics across Lattice.
This paper introduces a video-based learning from demonstration framework for robot-assisted rehabilitation, enabling therapists to remotely teach exercises. The system uses Cartesian Dynamic Movement Primitives (DMPs) to encode demonstrations into 6-DoF body-centric trajectories and executes them through a decoupled hybrid control architecture with a spatially compliant virtual tunnel and effort-based temporal dilation. A Gaussian Mixture Regression (GMR) model is learned on-the-fly from the patient's limb to detect abnormal forces and ensure safety by reversing the trajectory if needed, achieving trajectory reproduction errors of 3.7cm and ROM errors of 5.5 degrees.
Robots can now learn personalized rehabilitation exercises from videos and adapt to patient effort, offering a safer and more effective remote therapy solution.
In this paper, we propose a novel framework that allows therapists to teach robot-assisted rehabilitation exercises remotely via RGB-D video. Our system encodes demonstrations as 6-DoF body-centric trajectories using Cartesian Dynamic Movement Primitives (DMPs), ensuring accurate posture-independent spatial generalization across diverse patient anatomies. Crucially, we execute these trajectories through a decoupled hybrid control architecture that constructs a spatially compliant virtual tunnel, paired with an effort-based temporal dilation mechanism. This architecture is applied to three distinct rehabilitation modalities: Passive, Active-Assisted, and Active-Resistive, by dynamically linking the exercise's execution phase to the patient's tangential force contribution. To guarantee safety, a Gaussian Mixture Regression (GMR) model is learned on-the-fly from the patient's own limb. This allows the detection of abnormal interaction forces and, if necessary, reverses the trajectory to prevent injury. Experimental validation demonstrates the system's precision, achieving an average trajectory reproduction error of 3.7cm and a range of motion (ROM) error of 5.5 degrees. Furthermore, dynamic interaction trials confirm that the controller successfully enforces effort-based progression while maintaining strict spatial path adherence against human disturbances.
