Search papers, labs, and topics across Lattice.
This paper introduces MTEEG, a multi-task learning framework for EEG analysis that adapts a pre-trained model to multiple downstream tasks simultaneously using task-specific LoRA modules. The approach addresses the challenge of EEG heterogeneity across subjects, devices, and setups, which can cause task conflicts during joint optimization. Experiments on six downstream tasks demonstrate that MTEEG outperforms state-of-the-art single-task methods, suggesting the potential for more efficient and general-purpose BCIs.
Multi-task learning for EEG is now viable: a single model can beat fine-tuned single-task models on most metrics.
Recent self-supervised pre-training methods for electroencephalogram (EEG) have shown promising results. However, the pre-trained models typically require full fine-tuning on each downstream task individually to achieve good performance. In practical applications involving multiple tasks, utilizing a separate model for each task is not ideal regarding computational and spatial cost. In this study, we go one step further and explore the simultaneous adaptation of a pre-trained model to multiple different tasks. The EEG signals exhibit significant heterogeneity due to their collection from various subjects using diverse devices and experimental setups, resulting in potential conflicts among different tasks that impede joint optimization. To tackle this challenge, we propose MTEEG, a multi-task EEG analysis framework which incorporates task-specific low-rank adaptation (LoRA) modules to disentangle the parameter space and alleviate task conflicts. To investigate the trade-off between task specification and interaction, we propose three variants of MTEEG that integrate the LoRA modules in different ways and evaluate them on six downstream tasks, demonstrating that MTEEG can surpass state-of-the-art single-task methods on the majority of metrics. MTEEG shows the potential of multi-task EEG analysis and promotes the development of general-purpose brain-computer interfaces in the future.