Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a multimodal framework that synthesizes 3D gait data for pathological classification using structured textual descriptions, addressing the scarcity of real-world gait datasets. By employing a novel pathological tokeniser and LLM-guided semantic augmentation, the method generates synthetic gait sequences that retain critical motion characteristics. Experiments demonstrate that integrating these synthetic sequences with real data significantly enhances classification performance, achieving an accuracy of 92.77% with a GRU classifier.
Synthetic gait data can boost classification accuracy by over 10% when combined with real samples, transforming how we approach pathology in movement analysis.
Pathological gait datasets remain scarce due to privacy, recruitment, cost, and movement variability. Our work presents a multimodal LLM-guided framework for pathology-aware 3D gait data synthesis from structured textual descriptions. The proposed method generates fixed-length synthetic skeleton-based gait sequences for pathological gait classification tasks. The framework combines motion tokenisation, pathology-aware language conditioning, LLM-based semantic augmentation, and language-to-gait generation. A key contribution is the proposed pathological tokeniser, which is designed to preserve pathology-specific motion characteristics during discrete representation learning. Experiments suggest that the proposed synthetic sequences improve downstream classification for recurrent classifiers when combined with real data. The best result is obtained using a GRU classifier trained with real and synthetic samples, achieving 92.77\% accuracy under a leave-one-subject-out protocol.