Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a comprehensive multimodal dataset comprising 1020 hours of synchronized EEG, EMG, and audio recordings from three native Japanese speakers during open-vocabulary speech. The dataset, collected using three different EEG systems, facilitates advanced research in speech decoding, multimodal signal processing, and EEG representation learning, while also providing detailed annotations and transcriptions. Technical validation confirms the dataset's reliability, showcasing expected spectral profiles and event-related potentials across various tasks and devices.
A groundbreaking dataset of over 1000 hours of EEG, EMG, and audio recordings reveals new avenues for understanding speech production and multimodal interactions.
We present a multimodal dataset of 1020 hours of simultaneously recorded scalp electroencephalography (EEG), facial electromyography (EMG), and speech audio from three healthy native Japanese speakers during open-vocabulary overt speech. Recordings were acquired with three EEG systems-an ultra-high-density system (g.Pangolin) and two cap-type systems (g.SCARABEO and eegosports), spanning 62-128 channels-across many sessions over several months. Each session provides time-synchronized EEG, facial EMG, and audio, together with speech-event annotations and transcriptions. Although collected with speech decoding as a primary motivation, the dataset also supports work on multimodal signal processing, artifact modeling, longitudinal and cross-device adaptation, and EEG representation learning. Technical validation included power spectral density and event-related potential analyses across participants, devices, and tasks, which showed the expected 1/f spectral profile, task-related alpha-band attenuation, and time-locked evoked responses. The dataset is released in Brain Imaging Data Structure (BIDS) format via OpenNeuro under a CC0 waiver to support both speech-related and broader EEG research.