Search papers, labs, and topics across Lattice.
This paper conducts a causal audit of relayed key-value (KV) caches in multi-agent large language models (LLMs) to assess the impact of latent communication on performance. The findings reveal that when the receiver requires the sender's private information, relaying relevant caches yields a performance ceiling of 100%, compared to only 23-25% for irrelevant relays, across various model families and tasks. In scenarios where the receiver does not need private information, the performance remains equivalent within a narrow margin, indicating that the benefits of relayed caches are context-dependent rather than universally advantageous.
Relayed key-value caches can boost performance to 100% when private information is needed, but irrelevant relays plummet to just 23-25%.
Multi-agent LLM systems relay key--value caches instead of text and credit their gains to exchanged ``latent thoughts''. That credit is a claim about \emph{which} example's cache is relayed, not merely that one is. We audit it causally in released systems. The cache is replaced with deranged (mismatched-example), zeroed, and moment-matched random counterparts, under two regimes defined by whether the receiver needs the sender's private information. Where it does, the battery reads ceiling: 100\% against 23--25\% for answer-irrelevant relays on the primary backbone, a contrast replicated across three families, five checkpoints, and a prose document-QA surface. Where it does not, a pre-registered five-seed protocol establishes equivalence within 2.8 points, a margin anchored to the audited system's reported gain, under Holm-corrected TOST on GSM8K and ARC-Challenge across three Qwen3 scales and on MedQA at 8B (one cell shows a small detected advantage inside the margin); a second family shows no detected advantage. A large cache effect need not be a pairing effect. In one natural cell, zeroing the relay costs 14.7 points; a mismatched cache, 0.4. Nor is need sufficient: under the same test, delivered channels span ceiling (LatentMAS's native relay), partial (KVComm's layer subset), and no detected example-specific transfer (C2C's released projector). Benchmark deltas do not by themselves establish latent-thought transmission; establishing it takes a mismatched-cache audit, which we release.
