Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces an intelligent decision support system that utilizes smart glasses and a smartphone to monitor emotional states through microscopic visual fixation dynamics, addressing the limitations of traditional emotion detection methods. By analyzing three distinct neurophysiological micro-movements—microsaccades, ocular drifts, and ocular microtremors—the system employs a hybrid AI pipeline that combines multi-head attention, extreme gradient boosting, and support vector machines for effective on-device classification. The framework demonstrates superior discriminative power for emotion inference compared to macroscopic gaze metrics, achieving a personalized F1-score of 83.6% through a few-shot personalization mechanism validated across diverse scenarios with 60 participants.
Microscopic eye movements can provide a more accurate and less intrusive method for real-time emotion monitoring than traditional facial and physiological signals.
The rising prevalence of psychological disorders necessitates effective emotion monitoring, yet current methods relying on facial or physiological signals often suffer from intrusiveness and privacy issues. This paper proposes an intelligent decision support system and pervasive edge-computing framework that leverages smart glasses and a companion smartphone to infer emotional states from microscopic visual fixation patterns. Moving beyond traditional macroscopic gaze metrics, the proposed system extracts and decomposes three distinct neurophysiological micro-movements: microsaccades, ocular drifts, and ocular microtremors. We introduce an interpretable hybrid artificial intelligence pipeline combining a multi-head attention mechanism, extreme gradient boosting, and a support vector machine to extract deep temporal features, quantify their physiological importance, and perform efficient on-device classification. Through an extensive evaluation involving 60 volunteers, we rigorously validate the framework under a strict leave-one-subject-out cross-validation protocol across both controlled and naturalistic mobile scenarios. Ablation studies unequivocally demonstrate that these fixational micro-movements are substantially more discriminative for emotion inference than traditional macroscopic features. Furthermore, aligned with contemporary affective science, the system incorporates a few-shot personalization mechanism to bridge universal physiological baselines with individual emotional heterogeneity, achieving a highly robust personalized F1-score of 83.6%. This work establishes a physiologically interpretable, unobtrusive, and deployable paradigm for continuous real-time emotion monitoring.