Search papers, labs, and topics across Lattice.
This study evaluates deep multivariate imputation models on wearable device data, specifically addressing the issue of structured missingness where features from the same sensor drop out simultaneously. By developing a novel evaluation protocol that preserves co-missingness structure and stratifies missing data by gap length, the authors demonstrate a 43% reduction in mean absolute error (MAE) for the BRITS model when trained under this realistic missingness distribution. The findings reveal that model performance varies significantly based on the evaluation design, emphasizing the need for improved imputation strategies in multi-sensor wearable datasets.
Traditional evaluation methods obscure the true capabilities of imputation models, with model performance varying drastically based on how missing data is simulated.
Wearable device data enables continuous health monitoring, but suffers from structured missingness: features sharing a physical sensor drop out together. Deep imputation methods such as BRITS and SAITS have seen limited evaluation on multimodal physiological data under realistic missingness, and existing benchmarks use random-point holdout protocols that incorrectly assume missingness is independent across features and time. Using data from a person with epilepsy recorded on a Garmin smartwatch, we develop an evaluation protocol that mines contiguous missing-run templates from training data, stratifies them by per-feature gap-length quantiles, and injects them as block masks with preserved co-missingness structure. A matched training protocol exposing models to the same missingness distribution reduces BRITS's severe-gap MAE by 43%, demonstrating the potential benefit of the proposed evaluation and training protocol within this single-participant dataset. We further extend BRITS with time-of-day encoding and a circadian harmonic channel. No single model dominates: linear interpolation is optimal for slow-moving features over short gaps; extended BRITS achieves lower MAE on dynamic cardiac features in moderate and severe gaps; and SAITS better preserves the ground-truth distribution by Jensen-Shannon distance despite higher MAE. Ultimately, model rankings strongly depend on evaluation designs. By exposing how traditional evaluation methods obscure true model capabilities, our transferable protocol establishes critical steps towards developing better imputation strategies for future multi-sensor wearable datasets.
