Search papers, labs, and topics across Lattice.
This study explores the integration of electroencephalogram (EEG) signals with eye-tracking data to enhance automatic keyphrase extraction (AKE) from microblogs, addressing the limitations of using eye-tracking alone. By analyzing a combination of 8 EEG features and 17 eye-tracking features, the researchers injected these signals into the soft-attention and self-attention layers of AKE models. The findings reveal that EEG signals significantly improve AKE performance, demonstrating the potential of multimodal cognitive signals in this context, with EEG features yielding the most substantial benefits.
EEG signals can dramatically enhance keyphrase extraction from microblogs, outperforming traditional eye-tracking methods alone.
Microblogging platforms generate massive amounts of short, noisy, and dispersed user content, making automatic keyphrase extraction (AKE) an important but challenging task. Prior studies have used eye-tracking signals to improve microblog-based AKE because such signals reflect readers' attention to salient words. However, eye tracking alone is limited by physiological, acquisition, and feature-decoding constraints. To address this issue, we investigate whether electroencephalogram (EEG) signals can complement eye-tracking signals for AKE. Using the ZuCo cognitive language processing corpus, we select 8 EEG features and 17 eye-tracking features and incorporate them into microblog-based AKE models. To reduce possible distortion of cognitive signals by model structures, we inject these features into the input of the soft-attention layer and the query vectors of the self-attention layer. We then evaluate different combinations of cognitive signals across AKE models. The results show that cognitive signals produced during reading consistently improve AKE performance, regardless of feature combinations and model architectures. EEG features bring the largest gains, while combining EEG and eye-tracking features yields performance between the two individual signal types, suggesting partial complementarity but also possible redundancy or noise. These findings indicate that EEG signals provide useful cognitive evidence for microblog-based AKE and that multimodal cognitive signals deserve further investigation.
