Search papers, labs, and topics across Lattice.
This paper introduces SL-S4Wave, a self-supervised learning framework designed to model long-sequence physiological waveforms, particularly focusing on ECG data. By integrating contrastive learning with a specialized encoder based on structured state space models, SL-S4Wave effectively captures both local patterns and long-range dependencies in noisy, multichannel signals. Experimental results reveal that SL-S4Wave outperforms existing methods in arrhythmia detection with fewer labeled examples and demonstrates strong generalization across different types of arrhythmias and EEG tasks.
SL-S4Wave achieves state-of-the-art performance in arrhythmia detection while requiring significantly fewer labeled examples than traditional methods.
Modeling long-sequence medical time series data, such as electrocardiograms (ECG), poses significant challenges due to high sampling rates, multichannel signal complexity, inherent noise, and limited labeled data. While recent self-supervised learning (SSL) methods, based on various encoder architectures such as convolutional neural networks, have been proposed to learn representations from unlabeled data, they often fall short in capturing long-range dependencies and noise-invariant features. Structured state space models (S4) excel at long-sequence modeling, but existing S4 architectures fail to capture the unique characteristics of multichannel physiological waveforms. In this work, we propose SL-S4Wave, a self-supervised learning framework that combines contrastive learning with a tailored encoder built on structured state space models. The encoder incorporates multi-layer global convolution using multiscale subkernels, enabling the capture of both fine-grained local patterns and long-range temporal dependencies in noisy, high-resolution multichannel waveforms. Extensive experiments on real-world datasets demonstrate that SL-S4Wave (1) consistently outperforms state-of-the-art supervised and self-supervised baselines in a challenging arrhythmia detection task, (2) achieves high performance with significantly fewer labeled examples, showcasing strong label efficiency, and (3) maintains robust performance on long waveform segments, highlighting its capacity to model complex temporal dynamics in long sequences that most existing approaches fail to efficiently model, and (4) transfers effectively to unseen arrhythmia types, underscoring its robust cross-domain generalization. We additionally evaluate SL-S4Wave on multiple EEG tasks, achieving superior performance over strong baselines, demonstrating generalizability of our approach beyond cardiac waveforms.
