Search papers, labs, and topics across Lattice.
This study introduces a transformer-based framework that leverages point cloud data to automatically assess the quality of rehabilitation exercises by analyzing joint positions from RGBD images. The method addresses limitations of existing approaches by employing a curve-based feature aggregation technique and axial self-attention to enhance the model's ability to recognize important joints and their roles in exercise performance. Experimental results demonstrate that the proposed system not only outperforms current methods but also offers practical advantages such as compact size and rapid inference, making it suitable for home-based rehabilitation monitoring.
A novel transformer framework achieves superior assessment of rehabilitation exercises by effectively extracting and utilizing joint position features from RGBD data.
Rehabilitation exercises are essential in restoring lost physical functions of patients suffering from various diseases (e.g., Parkinson's, back pain). Carrying out these rehabilitation exercises, often prescribed by health experts, is costly, unavailable, and requires expert supervision. The availability of RGBD images and movement/position data of joints along with expert annotation of exercise data has prompted the use of automatic assessment of the quality of rehabilitation exercises, which is cost-effective and can be carried out at home. However, existing approaches do not extract relevant features, lack practical application, require expensive pre-processing, or overlook crucial features. This study proposes a transformer-based framework for point clouds to extract features and assess rehabilitation exercises by analyzing joint positions collected through RGBD data. We adapt and utilize a curve-based point-cloud feature aggregation technique to augment point-cloud information that aids model output. The transformer architecture also uses axial self-attention, recognizing important joints and their roles to assist users in performing the exercise better. The guided system outperforms existing approaches and is also practically relevant due to its small size, fast inference, and generalization on specific joints in similar exercises. We conduct our experiments on three crucial baseline datasets for rehabilitation exercises: Kimore, UI-PRMD, and IRDS.
