Search papers, labs, and topics across Lattice.
This study explores how personality and emotion profiles of LLM agents impact the performance of multi-agent teams in software engineering tasks, specifically code generation and code review. Utilizing a psychology-informed framework, the authors evaluate 78 different team configurations across four LLMs and 659 task instances, revealing that the choice of agent profiles can lead to significant variations in performance, with the best configurations achieving up to an 11.3 percentage point advantage in pass rates. Additionally, the findings indicate that certain profiles can negatively affect collaboration dynamics, leading to increased revision activity without consistent performance improvements, highlighting the importance of agent design in multi-agent systems.
Agent personality profiles can drive performance differences of over 11 percentage points in multi-agent software engineering tasks, revealing a critical design factor often overlooked.
Multi-agent LLM systems for Software Engineering (SE) typically differentiate agents through roles and workflows, but little is known about how agents' behavioral profiles affect team performance. We investigate the impact of personality and emotion profiles on LLM agent teams using a psychology-informed framework that combines Big Five personality traits, basic emotions, SE-relevant work styles, and task roles. We evaluate 78 team-profile configurations across code generation and code review using four LLMs and 659 task instances. Results show that profile choice substantially affects both performance and team behavior. For code generation, the gap between the best and worst shared-profile configurations reaches 7.1-11.3 percentage points in pass@1 across models, while the best mixed-profile configuration outperforms the best shared-profile configuration in six of eight model-task settings. Profiles also influence collaboration dynamics and cost: fear and high-conscientiousness profiles increase revision activity, over-revision, and token usage without consistent performance gains. These findings identify agent profiles as an important design dimension in multi-agent SE systems, affecting not only task outcomes but also the efficiency of collaboration.
