Search papers, labs, and topics across Lattice.
This paper introduces BioModule, a lightweight temporal transformer that integrates with existing 3D human pose estimators to predict biomechanical attributes without altering the upstream models. By leveraging a newly constructed large-scale dataset that aligns video data with biomechanical labels, the authors achieve frame-accurate cross-modal supervision for training. The results demonstrate that BioModule effectively enhances the interpretability of motion analysis across various pose estimation frameworks, marking a significant advancement in the application of pose estimation in fields like rehabilitation and sports science.
BioModule transforms any 3D pose estimator into a tool for biomechanical analysis, bridging the gap between geometric accuracy and physical interpretability.
Recent progress in 3D human pose estimation has made markerless recovery of skeletal motion increasingly accurate and scalable. However, most pose estimators remain optimized for geometric keypoint accuracy, while many real-world applications in rehabilitation, sports science, ergonomics, and clinical movement analysis require biomechanical quantities that describe how the body moves, loads, and activates. In this work, we propose BioModule, a lightweight plug-in temporal transformer that attaches downstream of any 3D pose estimator and predicts biomechanical attributes from standard 17-joint 3D skeletons. BioModule is estimator-agnostic and requires no modification of the upstream pose model, enabling existing pose estimators to be extended toward physically interpretable motion analysis. To train and evaluate BioModule, we construct a large-scale aligned dataset pairing Human3.6M video and 3D keypoints with the biomechanical label space of Human3.6Mplus. We establish and verify anatomical correspondence between coordinate systems of the two datasets, enabling frame-accurate cross-modal supervision. Using this aligned supervision, BioModule predicts biomechanical quantities. We further benchmark BioModule across seven state-of-the-art 3D pose estimators, providing the first systematic analysis of how upstream pose estimation quality propagates to downstream biomechanical prediction fidelity. The results position BioModule as a compact, modular bridge between vision-based pose estimation and biomechanically meaningful human motion analysis.
