Search papers, labs, and topics across Lattice.
To tackle clinical distribution shifts and severe class imbalance in Parkinsonian gait assessment, the authors train a lightweight Bi-GRU on 3D SMPL kinematic sequences using joint classification and text-alignment objectives with Qwen2.5-generated motion captions. Domain-specific fine-tuned models are subsequently consolidated via parameter-level merging and augmented with GPT-5.5 pseudo-labeling to ensure robustness on unseen clinical sites without inference-time class-prior corrections. The resulting system ranked 3rd in the MoCha 2026 challenge, achieving a 0.57 macro-F1 score on the hidden evaluation set using only 637K active parameters.
Tiny models can conquer severe clinical domain shifts: grounding 3D kinematic sequences in LLM-generated semantic descriptions and merging source-domain weights delivers top-tier Parkinsonian gait severity prediction with just 637K active parameters.
In this work, we introduce language-aligned motion representations for domain-generalizable UPDRS-Gait severity estimation, aiming to learn semantically structured motion features that generalize across heterogeneous clinical domains. We first learn motion representations using a Bi-GRU backbone that captures the temporal dynamics of SMPL sequences. Prior to model training, motion captions are generated offline using Qwen2.5-7B-Instruct. The backbone is then trained with both classification and text-alignment objectives to learn discriminative and semantically structured motion representations while accounting for the class imbalance present in the training data. We subsequently adapt the learned backbone independently to each source domain so that the model can capture domain-specific motion characteristics. The resulting source-specific models are then merged at the parameter level to consolidate complementary knowledge across source domains into a single domain-generalized model. To further mitigate class imbalance, we perform GPT-5.5-based pseudo labeling, and our final merged models for each site do not use any class-prior correction during inference. The resulting model is evaluated under the unseen-site setting of the MoCha Challenge, using Macro F1 as the primary evaluation metric. Our method achieves a macro-F1 of 0.57 on the hidden test set with only 637K active parameters at inference, ranking 3rd among 58 leaderboard entries in the MoCha 2026 Challenge. The challenge attracted 1,669 submissions from 112 participants and offered monetary prizes sponsored by Machine Medicine Technologies.
