Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To evaluate how camera geometry affects movement error detection, this work benchmarks single- and multi-view RGB pose estimation pipelines using REHAB26-ViewAngles, a new multi-angle rehabilitation dataset evaluated via a novel error-separability metric. Automated movement quality systems typically default to frontal viewpoints despite severe planar occlusions that obscure clinically relevant kinematic faults. The authors show that optimizing a single 2D camera's viewpoint improves error separability by 16.9% over standard 0° frontal captures—frequently outperforming monocular 3D pose estimators—while dual-view configurations unlock up to an additional 13.1% gain.
Defaulting to standard frontal camera views severely degrades clinical pose monitoring: simply optimizing a 2D camera's angle boosts error detection by 17% and routinely beats complex monocular 3D estimators.
Automated quality assessment of rehabilitation exercises relies heavily on accurate human pose estimation from video data. Although numerous RGB-based pose estimation methods have been proposed, the impact of camera placement on detecting clinically relevant movement errors remains insufficiently explored. To address this gap, we introduce REHAB26-ViewAngles, a dataset comprising correct and incorrect rehabilitation exercise executions captured from a wide range of camera angles. Furthermore, we propose a novel separability metric to quantify an algorithm's ability to distinguish between valid and faulty exercise repetitions. Using these tools, we analyze how various RGB-based pose-estimation strategies are suitable for exercise quality assessment under varying camera placements. In particular, we analyze single-camera 2D and 3D pose estimation and four multi-camera strategies: a combination of two orthogonal 2D views, 3D triangulation, weighted 3D fusion, and an AI-based pose-estimation transformer model specifically trained from two synchronized cameras. Our findings reveal that an optimally placed 2D camera can improve the separability by 16.9\,\% over the commonly used $0^\circ$ frontal view and frequently outperforms single-camera 3D estimation, while combining two views can further improve accuracy by up to 13.1\,\%. These results offer practical guidance for deploying rehabilitation monitoring in both home and clinical settings.