Search papers, labs, and topics across Lattice.
This study explores the prediction of cognitive load in natural dyadic conversations by analyzing speech and interaction dynamics, moving beyond controlled laboratory settings. Using audio from 53 dyads engaged in nine collaborative tasks, the researchers trained a two-head Gated Recurrent Unit encoder on various acoustic and interaction features to estimate cognitive load scores. Key findings reveal that conversational dynamics, such as turn-taking and participation imbalance, are significant predictors of cognitive load, particularly under time pressure and mental demand conditions.
Conversational dynamics can reveal hidden cognitive load signals, with turn-taking and participation patterns offering insights into mental effort during collaborative tasks.
Estimating cognitive load from speech has largely been studied in controlled laboratory settings, with limited understanding of its reliability in natural collaborative conversations. We investigate whether speech and interaction dynamics predict perceived cognitive load during dyadic conversations. We analyze audio from 53 dyads performing nine collaborative tasks and extract static acoustic, dynamic, and interaction features to train a two-head Gated Recurrent Unit encoder to predict cognitive load scores. Results show conversational interaction provides useful signals for predicting cognitive load related to time pressure, mental work, effort, and task performance. Temporal demand is associated with turn-taking dynamics such as overlap and speaker switch, while mental demand is linked to imbalanced participation between speakers. These findings highlight the importance of task structure and conversational interaction for modeling cognitive load in natural collaborative settings.