Search papers, labs, and topics across Lattice.
This paper presents MuyBridge, an innovative mobile system that estimates the 3D center of mass (CoM) of athletes using a single camera video stream, addressing the limitations of existing methods that require complex setups or lack anatomical accuracy. By integrating a compact 2D pose network with a distilled monocular depth network through analytic metric fusion, MuyBridge leverages anatomical and physical priors to produce accurate CoM estimates without the need for extensive supervision. The system demonstrates impressive performance with a vertical CoM error of 33-41 mm and an absolute-relative range error of 2.3-6.6%, operating at a high frame rate on standard mobile devices.
Achieving accurate center of mass estimation from a single smartphone camera could revolutionize athlete performance analysis in real-world settings.
The 3D center of mass (CoM) is a primary quantity in the biomechanical analysis of sport, rehabilitation, and clinical movement, yet existing 3D pose tracking, mesh recovery, and multi-view triangulation methods either optimize 3D keypoint accuracy without anatomical constraints or carry compute and capture infrastructure too heavy to deploy where CoM tracking is most useful. As a result, the metric CoM remains difficult for coaches and movement analysts to measure from a single camera where athletes train and compete. In this work, we introduce MuyBridge, an on-device system that estimates the athlete's segmental center of mass trajectory from a single phone camera video stream. MuyBridge couples a compact 2D pose network and a distilled single-step monocular depth network through an analytic metric fusion that uses anatomical and physical priors to anchor the metric CoM, requiring no 3D or task-specific supervision. Evaluated on the athletic movements of AthletePose3D (running, track and field, and figure skating), MuyBridge achieves 33-41 mm vertical CoM error and 2.3-6.6% absolute-relative range error (AbsRel) under a one-time calibration, and produces CoM estimates at the 63 FPS pose-estimation rate using asynchronous 2.86 Hz depth updates on iPhone 15. Code is available at: https://github.com/Abradshaw1/Muybridge
ETH