Search papers, labs, and topics across Lattice.
This paper investigates the impact of multi-agent communication on performance in LLMs, revealing that full-solution interaction can lead to a convergence of proposals that diminishes the diversity of solutions. Through experiments on 11 verifier-scored optimization tasks, the authors demonstrate that independent proposal generation outperforms full-solution interaction, which often results in agents adhering too closely to the initial solutions they encounter. The findings highlight that the effectiveness of multi-agent systems is contingent on the quality and timing of information shared, rather than merely the number of agents involved.
Full-solution interaction in multi-agent LLMs can erase diversity, leading to suboptimal performance despite the presence of multiple agents.
Does multi-agent LLM interaction help or hurt? Some work reports gains from debate (Du et al., 2024), critique loops (Chen et al., 2025), and mixture-of-agents synthesis (Wang et al., 2025), while other work finds that interaction adds cost without improving quality under equal budgets (Tran & Kiela, 2026; Xu et al., 2026; Jarrett et al., 2025), or that independent sampling already captures multi-agent gains (Li et al., 2024). We argue this contradiction partly reflects a missing distinction, because not all multi-agent communication is equal. Different model families find structurally different solutions, but when agents read each other's complete outputs, their proposals converge within one round, erasing the diversity that motivates using multiple models. We call this the interaction tax. We test 11 verifier-scored optimization tasks under matched budgets and find that full-solution interaction is a weak default. Independent proposal generation avoids this collapse. Full-solution interaction mainly makes agents stay close to the first solution they see instead of trying different approaches, and critique helps only if the violated rule is easy for the LLM to find and fix. These results suggest that multi-agent performance depends less on the number of agents than on the information they exchange, and interaction helps only when agents share the right information at the right time.
