Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper establishes a comprehensive framework for latent communication in multi-agent systems utilizing large language models (LLMs), addressing the limitations of traditional natural language communication. By categorizing existing methods across three axes—information type, sender-receiver alignment, and information fusion techniques—the authors identify key design patterns and highlight open challenges in the field. The findings aim to streamline research efforts and enhance the efficiency of agent communication, paving the way for more effective multi-agent collaborations.
Latent communication can significantly reduce inference costs and information loss in LLM-based multi-agent systems, offering a more efficient alternative to traditional natural language protocols.
Multi-agent systems built on large language models (LLMs) have become a prevailing paradigm for tackling complex reasoning, planning, and tool-use tasks. The dominant communication protocol in such systems is natural language: agents exchange messages token-by-token, verbalising their internal reasoning so that peers can read, verify, and respond. While convenient and interpretable, this protocol suffers from three structural drawbacks -- high inference cost, irreversible information loss during discretization, and ambiguity/redundancy of natural language. A growing body of work therefore explores an alternative protocol -- latent communication -- in which agents exchange continuous representations (embeddings, hidden states, or KV-caches) directly, bypassing the bottleneck of text generation. This paper presents a unified framework for organising the rapidly expanding literature on latent communication. We analyse existing methods along three orthogonal axes: (1) WHAT information is communicated (Embeddings, Hidden States, KV-Caches, or other continuous state); (2) WHICH sender-receiver alignment is used (latent-space alignment and layer alignment); and (3) HOW the communicated information is fused into the receiver (concatenation, prepending, mathematical operations, cross-attention, or cache restoration). Under this 3-axis framework, we systematically categorise eighteen representative methods proposed between 2024 and 2026, identify five major design patterns, and surface a set of open challenges -- including cross-architecture alignment, security of latent channels, compression for edge deployment, and the relationship between latent communication and latent chain-of-thought. We hope that this framework both lowers the barrier to entry for new researchers and provides a vocabulary for comparing future work.