Search papers, labs, and topics across Lattice.
This study integrates adult attachment theory into the evaluation of large language models (LLMs) to assess their emotional companionship capabilities in intimate relationships. By introducing the emotional companionship benchmark (ECBench), the authors evaluate 32 LLMs across various scenarios, revealing how attachment styles influence model interactions in contexts such as emotional support and conflict resolution. Key findings indicate that attachment tendencies can be shaped through prompting, offering insights into selecting LLMs for effective emotional companionship.
Emotional companionship capabilities of LLMs can be significantly influenced by their attachment styles, which can be shaped through targeted prompting.
As large language models (LLMs) are increasingly applied for emotional companionship, evaluating their behavior and capabilities in intimate relationships has become a pressing issue. However, existing assessments primarily characterize general personality traits, providing limited insight into model behavior within intimate and emotionally sensitive contexts. Therefore, we introduce adult attachment theory into LLM evaluation and use the Experiences in Close Relationships-Revised (ECR-R) scale to characterize attachment anxiety and avoidance. To evaluate emotional companionship capabilities of LLMs in realistic interaction scenarios, we present an emotional companionship benchmark, ECBench, spanning four scenarios including emotional support, collaborative tasks, conflict resolution, and social guidance, across friendship and romantic relationships. ECBench is utilized to assess model behavior using 11 dialogue-quality metrics and three evaluation methods. We evaluate the attachment tendencies of 32 LLMs and select representative models to investigate how these tendencies manifest in contextualized multi-turn interactions and whether they can be shaped through prompting. Our study provides a theoretical lens from psychology, along with practical tools to understand and select LLMs for emotional companionship.
