Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
ArmPoser enables real-time 3D arm pose estimation from a single smartwatch IMU by training models directly within the device's native sensor coordinate frame. This approach bypasses standard preprocessing pipelines, eliminating the coordinate transformations, bone-offset calibrations, and drift-prone alignment steps that typically hinder real-world wearable deployment. Evaluated across watchOS and Android devices spanning 30 activities, the system matches or exceeds the accuracy of fully calibrated baselines without requiring any calibration gestures from the user.
Wearable arm pose estimation no longer requires awkward calibration poses or coordinate transforms: learning directly in the device's native IMU frame matches calibrated state-of-the-art baselines out of the box.
Arm pose estimation enables applications in fitness, extended reality input, rehabilitation, and life logging. Prior smartwatch-based approaches rely on calibration poses and preprocessing pipelines that transform raw IMU measurements into standardized training formats. These steps hinder deployment in everyday settings and introduce errors due to imperfect calibration and sensor drift. We present ArmPoser, a calibration-free arm pose estimation system using a single smartwatch IMU. Our central contribution is training models directly in the reference frame native to consumer smartwatches, aligning learning with how IMU data is produced by deployed devices. By operating on device-native axes, ArmPoser removes the need for coordinate transformations, explicit alignment, and bone-offset calibration used in prior work. We further augment training with physically grounded variations in watch placement and arm morphology to account for user-specific variability. ArmPoser also includes a wear-configuration module that infers anterior or posterior forearm placement and crown orientation. We evaluate pose estimation on public benchmarks and on a 10-participant, 30-activity study using watchOS and Android smartwatches, where ArmPoser matches or exceeds calibrated baselines without any user calibration.