Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
MambaGaze tackles cognitive load assessment from eye-tracking data by explicitly modeling missing data with observation masks and time-deltas (XMD encoding) and employing bidirectional Mamba-2 to efficiently capture long-range temporal dependencies. This approach significantly outperforms CNN, Transformer, ResNet, and VGG baselines on CLARE and CL-Drive datasets, achieving 76.8% and 73.1% accuracy, respectively. Furthermore, MambaGaze demonstrates real-time inference capabilities on edge devices, making it suitable for wearable applications.
Eye-tracking AI can now handle missing data and long sequences in real-time, unlocking wearable cognitive load monitoring with MambaGaze's 4-12% accuracy boost and efficient edge deployment.
Real-time cognitive load assessment from eye-tracking signals could potentially enable adaptive human-centered-AI such as safety-critical applications such as driver vigilance monitoring or automated flight deck assistance, yet two challenges persist: handling frequent data missingness from blinks and tracking failures, and efficiently modeling long-range temporal dependencies. We propose MambaGaze, a framework that addresses these challenges through 1) XMD encoding, which augments raw features with observation masks and time-deltas to explicitly model data uncertainty, and 2) bidirectional Mamba-2, which captures temporal dependencies with linear computational complexity. Experiments on CLARE and CL-Drive datasets under leave-one-subject-out evaluation show that MambaGaze achieves 76.8% and 73.1% accuracy, respectively, outperforming CNN, Transformer, ResNet, and VGG baselines by 4-12 percentage points. Edge deployment benchmarks on NVIDIA Jetson platforms demonstrate real-time inference at 43-68 FPS with power consumption below 7.5W, confirming feasibility for wearable cognitive load monitoring.