Search papers, labs, and topics across Lattice.
This study introduces physiological noise augmentation (PNA) as a novel data augmentation technique for non-invasive brain-to-speech decoding, aimed at enhancing communication for patients with neurodegenerative diseases. By leveraging independent component analysis to separate clean brain signals from noise artifacts, PNA trains decoders to be resilient to physiological interferences, thus improving decoding accuracy. The implementation of PNA on the MegNIST dataset resulted in a significant 4.7 percentage point increase in EEGNet performance, demonstrating its effectiveness in reducing word error rates in non-invasive methods.
Training decoders to ignore physiological noise can boost brain-to-speech decoding accuracy by nearly 5%, transforming communication aids for neurodegenerative patients.
Non-invasive brain-to-speech decoding aims to restore communication to patients suffering from neurodegenerative disease, without the risks of neurosurgery. Existing MEG- and EEG-based methods, while scalable, continue to suffer from high word error rates driven by relatively low signal-to-noise ratios compared to invasive recordings. We propose physiological noise augmentation (PNA), a data augmentation method that explicitly trains decoders to become invariant to task-agnostic artifacts (e.g. ocular and cardiac activity). PNA draws inspiration from automatic speech recognition systems, where environmental noise (e.g. dogs barking, city traffic) is added to clean speech to improve robustness. Analogously, we decompose brain recordings into clean data and noise artifacts using independent component analysis (ICA), before scaling and remixing to generate biophysically realistic, label-preserving training examples. We show that PNA approximates anisotropic regularization, penalizing decoder sensitivity along artifact-dominated directions. On MegNIST, a 12k-trial imagined-digit MEG dataset, PNA with 10-trial averaging improves EEGNet decoding accuracy by 4.7 percentage points (absolute) over training on real data alone. Our results suggest that artifact-aware augmentation and trial averaging are complementary tools for improving robustness in non-invasive speech BCIs.
