Search papers, labs, and topics across Lattice.
This paper introduces the Multi-Order Communication (MOC) scheme for enhancing message transmission in LLM-based multi-agent systems by capturing multi-hop dependencies and optimizing message consolidation. The authors identify limitations in current communication methods that rely on first-order neighbor responses, leading to a loss of critical insights. Experimental results across six datasets show that MOC significantly improves task performance while reducing communication costs, highlighting its effectiveness in optimizing inter-agent communication.
Capturing multi-hop dependencies in agent communication can lead to significant performance gains and lower costs in LLM-based systems.
Despite the remarkable progress of Large Language Model (LLM) based Multi-Agent Systems, most research focuses on optimizing coordination topology while largely underexploring the equally critical problem: how to transmit and optimize messages among agents effectively? Current communication schemes typically rely on the direct concatenation of first-order neighbor responses, which induces a restricted evidence receptive field and leads to the dilution of crucial insights over multi-hop paths. To address these limitations, we propose the Multi-Order Communication (MOC) scheme, which reconstructs the inter-agent communication to capture multi-hop dependencies and incorporates a structural message consolidation strategy to ensure efficiency. Specifically, we formalize the communication mechanism to construct a structured multi-order evidence stream, and subsequently design a Semantic-Topological Merging algorithm to optimize semantic fidelity within token constraints. Extensive experiments across six diverse datasets and LLM backbones of varying parameter scales demonstrate that MOC consistently improves task performance and reduces communication costs. The code is available at https://github.com/yao-guan/MOC.
