Search papers, labs, and topics across Lattice.
This paper introduces KinEMbed, a novel cross-modal contrastive learning framework designed to decode hand kinematics from surface electromyography (EMG) signals, addressing a significant gap in continuous regression tasks. By jointly training dual encoders for EMG features and kinematic targets, KinEMbed captures the geometric structure of kinematic space, allowing for effective inference without requiring kinematic signals. The framework demonstrates superior performance on the NinaPro DB8 dataset, particularly excelling in decoding challenging thumb movements compared to traditional methods like PCA and autoencoders.
KinEMbed achieves unprecedented accuracy in decoding hand kinematics from EMG, outperforming established methods and paving the way for advanced prosthetic control.
Decoding hand kinematics from surface electromyography (EMG) is a core challenge in wearable biosignal processing with clinical relevance for prosthetic control and motor rehabilitation. Most representation learning approaches for EMG focus on discrete gesture classification, and few focus on continuous regression. We present KinEMbed, a cross-modal contrastive learning framework for hand kinematics regression that jointly trains dual encoders -- one for windowed EMG features and one for kinematic (joint angle) targets. The resulting embeddings inherit the geometric structure of the kinematic space without requiring kinematic signals at inference time. Evaluating on the NinaPro DB8 dataset that includes both able-bodied users and subjects with limb difference (N=11), KinEMbed outperforms PCA, PLS, autoencoder and contrastive (CEBRA) baselines on held-out sessions, with largest gains on the most challenging thumb degrees of articulation. We position this work as a first step toward contrastive representation learning for regression of hand kinematics from structured wearable biosignals.
