Search papers, labs, and topics across Lattice.
This study investigates the performance of deliberative large language model (LLM) agents in joint decision-making tasks characterized by partial observability and asymmetric information. By formalizing deliberative collaboration as a cooperative decision problem, the authors introduce a scalable benchmark and evaluation protocol, revealing that current state-of-the-art LLMs struggle with complex deliberative tasks despite the potential for reflection and error correction. The findings highlight both the limitations of LLMs in collaborative reasoning and the opportunities for improving their performance through structured deliberation processes.
Current LLMs falter in complex deliberative collaboration tasks, revealing critical gaps in their reasoning capabilities even when aided by external tools.
Deliberation plays a crucial role in collaboration; when humans work together, they naturally engage in communication to align information and reach an agreement. In this paper, we investigate deliberative large language model (LLM) agents under partially observable joint decision-making tasks. We formalize deliberative collaboration as a cooperative joint decision problem with partial and asymmetric observations, and introduce a scalable benchmark that instantiates this problem across multiple task settings and domains in which agents must exchange information through deliberation to reach a joint decision with a shared reward. We then instantiate a reference scaffold and evaluation protocol for deliberative agents and conduct a systematic evaluation of a range of representative LLMs. The results reveal that complex deliberative collaboration tasks continue to challenge state-of-the-art language models. Even with the aid of external mathematical tools, language models may fail in either the deliberation process for aligning information or the complex reasoning process for making the decision. On the other hand, diagnostic analysis reveals that the deliberation process may also provide opportunities for reflection and error correction, sometimes improving performance over centralized baselines. Altogether, our work establishes a foundation for evaluating and improving LLM agents in deliberative collaboration and provides insights into the strengths, limitations, and properties of current LLM-based multi-agent systems.
Tsinghua AI