Search papers, labs, and topics across Lattice.
This paper introduces LLM-sEMG, a framework that leverages large language models (LLMs) for surface electromyography (sEMG) signal-based activity recognition. The core innovation lies in a language-oriented mapping mechanism that translates continuous sEMG sequences into a discrete "sEMG language" interpretable by LLMs. Experiments demonstrate that this approach achieves highly accurate sEMG-based activity recognition, suggesting LLMs can effectively interpret physiological signals when properly translated.
LLMs can now understand your muscle twitches: a novel framework translates sEMG signals into a language LLMs can interpret for highly accurate activity recognition.
Surface electromyography (sEMG) signal-based activity recognition has attracted increasing research attention in recent years. To develop accurate sEMG signal-based activity recognizers, numerous approaches have been proposed. Some studies focus on designing larger and more expressive model architectures to enhance the representational capacity of sEMG signals, while others aim to enrich model priors through large-scale pretraining, thereby improving recognition performance. Recently, large language models (LLMs) have shown remarkable generalization and reasoning capabilities in natural language processing, whose implicit knowledge, learned from extensive linguistic descriptions of actions, opens new possibilities for interpreting sEMG signals and inferring activity intentions. Motivated by this, we propose LLM-sEMG, a novel framework that leverages LLMs as sEMG activity recognizers. Within this framework, we design a language-oriented mapping mechanism that converts continuous sEMG sequences into sEMG language, integrating several strategies to further facilitate the signal-to-language mapping process. Extensive experiments demonstrate that the proposed framework achieves highly accurate sEMG signal-based activity recognition using large language models.
