Search papers, labs, and topics across Lattice.
The paper introduces M2HRI, a multimodal multi-agent framework using LLMs to imbue robots with distinct personalities and long-term memories, coordinated via a centralized mechanism. User studies (n=105) demonstrate that these LLM-driven personality traits are distinguishable and enhance interaction quality, while long-term memory improves personalization. Centralized coordination reduces task overlap and improves overall interaction quality in multi-robot settings.
Robots with distinct LLM-generated personalities and coordinated actions aren't just a gimmick – they measurably improve human-robot interaction quality and personalization in multi-agent settings.
Multi-robot systems hold significant promise for social environments such as homes and hospitals, yet existing multi-robot works treat robots as functionally identical, overlooking how robots individual identity shape user perception and how coordination shapes multi-robot behavior when such individuality is present. To address this, we introduce M2HRI, a multimodal multi-agent framework built on large language models that equips each robot with distinct personality and long-term memory, alongside a coordination mechanism conditioned on these differences. In a controlled user study (n = 105) in a multi-agent human-robot interaction (HRI) scenario, we find that LLM-driven personality traits are significantly distinguishable and enhance interaction quality, long-term memory improves personalization and preference awareness, and centralized coordination significantly reduces overlap while improving overall interaction quality. Together, these results demonstrate that both agent individuality and structured coordination are essential for coherent and socially appropriate multi-agent HRI. Project website and code are available at https://project-m2hri.github.io/.