Search papers, labs, and topics across Lattice.
This paper investigates the efficacy of positive controls and detection floors in scalp-EEG speech decoding by auditing overt and imagined speech decoding across three datasets, revealing that overt speech decoding is heavily influenced by myogenic artifacts and that current pipelines often fail to detect meaningful signals. The study quantifies the detection floor for various decoders by injecting known signal amplitudes, demonstrating that even substantial injected signals can go undetected by some architectures. The findings highlight critical pitfalls in existing datasets and methodologies, advocating for more rigorous reporting standards including band-limited accuracy and measured detection floors.
Overt speech EEG decoding is dominated by myogenic artifacts, rendering it an unreliable positive control for imagined speech BCI, and standard decoders can miss signals an order of magnitude larger than typical brain activity.
Objective. Studies that decode imagined speech from scalp electroencephalography (EEG) commonly validate their pipelines with a positive control, usually overt speech, and report null results without stating what effect size the pipeline could have detected. Approach. Using ds003626 ("Thinking out loud"), KaraOne and Track 3 of the 2020 International Brain-Computer Interface Competition, we audited decoding of overt speech, articulator preparation and imagined speech with artifact-channel subsets, band-limited decoding and trial selection, under a protocol that enforces split integrity by assertion. We injected class-dependent effects of known amplitude into the real recordings to measure the detection floor of five decoder families, and we checked the ds003626 labels against the dataset's acquisition protocol. Main results. On ds003626, two lip electrodes decoded overt speech at 0.7430 and the eight external channels at 0.7068, against 0.4231 for the 128-channel scalp montage, and no decodable signal survived in the 8-30 Hz band. On the other two corpora, within-subject accuracy rose monotonically with frequency into the range dominated by muscle activity. Band-power logistic regression detected an injected 8-30 Hz desynchronization of 0.54 uV under a criterion fixed in advance, whereas a compact convolutional network (EEGNet) detected nothing within subject up to 4.31 uV. In ds003626, the condition codes are the reverse of the intuitive reading, the class encoding changed between public releases, and condition is a deterministic function of time within each session. Significance. In these corpora the overt-speech positive control is dominated by myogenic signal and cannot validate a decoding pipeline. We recommend that speech-decoding studies report band-limited and artifact-channel accuracy, the direction of accuracy across frequency, and a measured detection floor.