Search papers, labs, and topics across Lattice.
Sonata is a compact latent world model designed for six-axis trunk IMU representation learning, specifically addressing the challenge of clinical data scarcity. By leveraging a harmonized corpus of nine public datasets, Sonata employs a latent world-model objective that predicts future states instead of reconstructing raw sensor traces, resulting in superior performance over a matched autoregressive forecasting baseline. The model demonstrates enhanced clinical discrimination, prospective fall-risk prediction, and effective cross-cohort transfer, all while maintaining a lightweight architecture suitable for on-device wearable applications.
Sonata outperforms traditional models in clinical kinematic assessments, achieving better fall-risk predictions with a fraction of the parameters.
We introduce Sonata, a compact latent world model for six-axis trunk IMU representation learning under clinical data scarcity. Clinical cohorts typically comprise tens to hundreds of patients, making web-scale masked-reconstruction objectives poorly matched to the problem. Sonata is a 3.77 M-parameter hybrid model, pre-trained on a harmonised corpus of nine public datasets (739 subjects, 190k windows) with a latent world-model objective that predicts future state rather than reconstructing raw sensor traces. In a controlled comparison against a matched autoregressive forecasting baseline (MAE) on the same backbone, Sonata yields consistently stronger frozen-probe clinical discrimination, prospective fall-risk prediction, and cross-cohort transfer across a 14-arm evaluation suite, while producing higher-rank, more structured latent representations. At 3.77 M parameters the model is compatible with on-device wearable inference, offering a step toward general kinematic world models for neurological assessment.
NVIDIA