Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces two innovative methods, Compositional Prototype Interpolation (CPI) and Synthetic Adaptation for Prototypes (SAP), designed to enable zero-shot learning for combined movements in surface electromyography (sEMG) applications. By leveraging a linear interpolation assumption in the embedding space, the authors demonstrate that their approaches can effectively recognize novel movements without the need for extensive retraining or additional data collection. Experimental results show that SAP achieves over 20% accuracy improvement on combined movements compared to existing zero-shot learning methods, maintaining this advantage in real-time user studies.
Achieving over 20% accuracy improvement in zero-shot classification of combined sEMG movements could revolutionize prosthetic control for upper-limb amputees.
Surface electromyography (sEMG) enables the control of prostheses, allowing upper-limb amputees to re-gain some hand function. Most current research focuses on recognizing basic movements for prosthesis control. However, in most daily activities, such as opening a door, combined movements are essential. However, collecting training data for all possible combined movements is time-consuming and requires re-training of the model for any new combination. We propose two novel recognition approaches, Compositional Prototype Interpolation (CPI) and Synthetic Adaptation for Prototypes (SAP), that enable zero-shot learning of combined, novel and unseen movements in Prototype Networks after training only with basic movements. Our methods rest on a linear interpolation assumption in the embedding space, which we study by inspecting the geometry of combined motions in signal and embedding space. In experiments on the NearLab and NinaPro DB3 data sets as well as our newly recorded BasCom dataset, our proposed SAP outperforms prior zero-shot learning methods with accuracy improvements on combined movements of more than 20%. This advantage is maintained in online inference experiments in a user study.