Search papers, labs, and topics across Lattice.
SleepPairNet, a multimodal self-supervised learning framework, leverages random-pair cross-attention to learn inter-modal relationships within physiological sleep signals. This approach enables richer representations for sleep analysis and disorder detection by capturing complex pairwise interactions. Pretraining on the NCH dataset demonstrates superior performance on respiratory tasks and competitive results on EEG tasks, with strong generalization to the external CHAT dataset.
Random-pair cross-attention unlocks robust multimodal sleep representations, outperforming baselines on respiratory tasks and generalizing effectively to new datasets.
Analyzing physiological sleep signals is important for assessing sleep quality and detecting sleep-related disorders. Learning inter-modal relationships across physiological signals can provide richer representations for downstream sleep analysis. We introduce \textbf{SleepPairNet}, a multimodal self-supervised learning (SSL) framework that learns pairwise interactions between physiological signals through cross-attention. We propose a random modality-pair selection strategy that exposes the model to diverse signal pairs during pretraining, enabling flexibility across modality combinations at test time. Pretrained on the NCH dataset, SleepPairNet outperforms the evaluated SSL baselines on all respiratory tasks while remaining competitive on EEG-related tasks, and shows even stronger results when transferred to the external CHAT dataset.