Search papers, labs, and topics across Lattice.
This paper introduces a novel trimodal data acquisition paradigm for speech production research, simultaneously capturing real-time MRI video, EEG, and surface EMG data. The authors address the significant technical challenges of MRI-induced artifacts by developing a tailored artifact suppression pipeline. This approach promises to provide a more comprehensive understanding of the neurophysiological processes underlying speech and facilitate advancements in brain-computer interfaces.
A new multimodal dataset links brain activity, muscle activation, and articulation in speech, opening doors to understanding the causal chain of speech production.
Speech production is a complex process spanning neural planning, motor control, muscle activation, and articulatory kinematics. While the acoustic speech signal is the most accessible product of the speech production act, it does not directly reveal its causal neurophysiological substrates. We present the first simultaneous acquisition of real-time (dynamic) MRI, EEG, and surface EMG, capturing several key aspects of the speech production chain: brain signals, muscle activations, and articulatory movements. This multimodal acquisition paradigm presents substantial technical challenges, including MRI-induced electromagnetic interference and myogenic artifacts. To mitigate these, we introduce an artifact suppression pipeline tailored to this tri-modal setting. Once fully developed, this framework is poised to offer an unprecedented window into speech neuroscience and insights leading to brain-computer interface advances.
