Search papers, labs, and topics across Lattice.
This paper introduces BioKD, a reliability-aware knowledge distillation framework that enhances video-based emotion recognition by leveraging physiological signals during training while using only video inputs at inference. By implementing a sample-wise reliability gating mechanism and a progressive distillation strategy, BioKD mitigates the impact of unreliable physiological supervision, leading to more stable cross-modal learning. Experimental results on DEAP and AMIGOS demonstrate that BioKD significantly outperforms baseline models in both trial-wise and subject-wise evaluations for valence and arousal recognition, achieving notable performance improvements without additional inference overhead.
BioKD achieves a remarkable 68.01% accuracy in trial-wise arousal recognition, showcasing the power of reliability-aware knowledge distillation in emotion recognition tasks.
To address the limitations of video-based emotion recognition under ambiguous or socially masked behavioral cues, as well as the poor deployability of physiological signals, this paper proposes a reliability-aware physiology-to-video knowledge distillation framework, termed BioKD. The proposed framework leverages physiological signals as privileged information during training to guide a video-based student model in learning deep affective representations, while relying solely on non-intrusive video inputs at inference time. To cope with the high noise and instability of physiological teacher supervision caused by inter-subject variability, signal artifacts, and temporal inconsistency, BioKD incorporates a sample-wise reliability-aware gating mechanism together with a progressive distillation strategy. By adaptively regulating the strength of knowledge transfer, the framework suppresses negative transfer induced by unreliable physiological supervision and enables more stable cross-modal distillation. Experiments on DEAP and AMIGOS show that BioKD consistently outperforms representative baselines under both trial-wise and subject-wise evaluation protocols for valence and arousal recognition. For example, BioKD achieves 68.01\% on DEAP (trial-wise arousal) and 65.29\% under the more challenging subject-wise setting, demonstrating improved performance under a subject-independent evaluation setting. Further analyses show that BioKD effectively mitigates overconfident teacher errors and outperforms an entropy-only weighting strategy, confirming the importance of explicitly modeling supervision reliability. In addition, BioKD introduces no additional inference-time overhead relative to the same video student architecture and removes the need for physiological sensing and multimodal synchronization.
