Search papers, labs, and topics across Lattice.
This paper explores a framework for "cognitively aligned" multi-agent robotic interactions that adapt to the user's internal cognitive state by utilizing a consumer-grade Brain-Computer Interface (BCI) to monitor EEG signals. By implementing a closed-loop architecture, the system defers communications from robotic agents during periods of high cognitive workload, thereby enhancing task performance and reducing cognitive overload. Preliminary results indicate that this approach effectively integrates real-time neurophysiological monitoring with multi-agent task execution, showcasing the potential for non-intrusive human-robot collaboration.
Cognitive alignment in robotic systems can significantly enhance task performance by deferring agent communications during high mental workload, as shown by real-time EEG monitoring.
While non-verbal behaviors and expressive movements are essential for natural human-robot interaction, existing methods often overlook a crucial element: the human's internal cognitive state. Frequently, proactive multi-agent systems can interrupt humans at inopportune moments, leading to cognitive overload and decreased task performance. This paper introduces a framework for generating"cognitively aligned"multi-agent interactions, enhancing the ability of robotic systems to contextually defer communications to the user of an agent system during moments of high human mental workload and engagement. We present the design and implementation of a closed-loop architecture that explores the interplay between autonomous task execution and real-time neurophysiological focus. Using a consumer-grade Brain-Computer Interface (BCI), our approach continuously monitors Electroencephalography (EEG) spectral band powers while a human performs an engagement-inducing task. We propose an engagement-driven pipeline where an HTTP-based signaling mechanism places a primary agent's sensory inputs and audio outputs into a holding state upon detecting high engagement. This allows secondary agents to seamlessly process complex, delegated tasks in the background. Once the human's cognitive state returns to a lower cognitive load baseline, the primary agent releases the queued agent message. Our preliminary results demonstrate the feasibility of leveraging real-time signal processing, Large Language Models (LLMs), and physical robotic embodiments to create cognitively-aware, non-intrusive multi-agent systems.
