Search papers, labs, and topics across Lattice.
This study systematically evaluates four open-source foundation models (FMs) trained on accelerometer data against supervised baselines across 19 tasks in activity recognition, clinical monitoring, and physiological inference. While supervised models excel in human action recognition, FMs demonstrate superior performance in fall and stress detection, showcasing robustness to variations in sensor placement. The findings highlight the potential of FMs as effective feature extractors, particularly for demographic inference, while also revealing limitations in sleep staging and complex activity recognition.
Foundation models outperform traditional supervised methods in fall and stress detection, challenging the notion that bigger always means better in health monitoring tasks.
Foundation models (FMs) trained on large-scale accelerometer data have been proposed as general-purpose feature extractors for health monitoring, but systematic evidence of their advantages is lacking. We present the first comprehensive evaluation of four open-source accelerometer FMs against supervised baselines covering 19 tasks across the domains of activity recognition including activities of daily living, clinical monitoring, and physiological inference. We find task-dependent performance results: supervised models remain competitive with FMs on human action recognition (HAR), with no consistent advantage for either, while selected FMs lead on fall and stress detection and are the most robust to sensor-placement variation. As frozen feature extractors, FMs are strongest for demographic inference, whereas sleep staging performance remains near chance level for all models. The internal FM representations show strong similarity across layers, highlighting potential for future FM improvements. Linear and frozen probing reveals that UniMTS provides the strongest representations and is the only FM that surpasses the supervised baselines without finetuning. Concept discovery analysis shows all models capture high-intensity activities clearly but struggle with sedentary, complex or ambiguous activities. We provide scenario-based deployment recommendations. Furthermore, we identify FM-derived activity profile inference-moving beyond fixed category classification-as a promising research direction.
