Search papers, labs, and topics across Lattice.
This paper introduces a self-supervised pretraining framework for remote photoplethysmography (rPPG) estimation in Pediatric Intensive Care Units (PICUs) using facial video. The framework employs a VisionMamba architecture with an adaptive masking mechanism guided by spatiotemporal importance scores and a teacher-student distillation setup to leverage labeled public datasets and unlabeled PICU data. The proposed method achieves a 42% reduction in mean absolute error compared to standard masked autoencoders and outperforms PhysFormer, demonstrating robustness to motion artifacts, occlusions, and domain shifts common in PICU environments.
A VisionMamba architecture with adaptive masking and self-supervised learning slashes heart rate estimation error by 42% in noisy pediatric ICU videos, rivaling contact sensors without touching the patient.
Continuous monitoring of vital signs in Pediatric Intensive Care Units (PICUs) is essential for early detection of clinical deterioration and effective clinical decision-making. However, contact-based sensors such as pulse oximeters may cause skin irritation, increase infection risk, and lead to patient discomfort. Remote photoplethysmography (rPPG) offers a contactless alternative to monitor heart rate using facial video, but remains underutilized in PICUs due to motion artifacts, occlusions, variable lighting, and domain shifts between laboratory and clinical data. We introduce a self-supervised pretraining framework for rPPG estimation in the PICU setting, based on a progressive curriculum strategy. The approach leverages the VisionMamba architecture and integrates an adaptive masking mechanism, where a lightweight Mamba-based controller assigns spatiotemporal importance scores to guide probabilistic patch sampling. This strategy dynamically increases reconstruction difficulty while preserving physiological relevance. To address the lack of labeled clinical data, we adopt a teacher-student distillation setup. A supervised expert model, trained on public datasets, provides latent physiological guidance to the student. The curriculum progresses through three stages: clean public videos, synthetic occlusion scenarios, and unlabeled videos from 500 pediatric patients. Our framework achieves a 42% reduction in mean absolute error relative to standard masked autoencoders and outperforms PhysFormer by 31%, reaching a final MAE of 3.2 bpm. Without explicit region-of-interest extraction, the model consistently attends to pulse-rich areas and demonstrates robustness under clinical occlusions and noise.
