Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
The authors establish theoretical bounds for optimal messaging in rate-limited Dec-POMDPs and evaluate learned reinforcement learning protocols against engineered senders across MuJoCo environments with varying physical coupling constrained to a 2-bit budget. They show that communication utility depends heavily on embodiment: rigid physical coupling renders channels redundant via proprioception, whereas partial coupling produces a severe failure where learned senders perform no better than silence (0.482 IQM) despite engineered senders achieving ceiling performance (1.000 IQM). Receiver warm-starting and cross-play analysis reveal that this performance gap is driven by RL optimization and protocol discovery failures rather than bandwidth limits, with cross-play mutual intelligibility collapsing from 0.980 in self-play to 0.144 across seeds.
Multi-agent RL completely fails to discover 2-bit communication protocols that engineered senders use to solve tasks perfectly, demonstrating that emergent communication bottlenecks stem from optimization failures rather than information-theoretic bandwidth.
Rate-limited multi-agent teams raise three questions the emergent-communication literature has answered only empirically: what an optimal message should encode, what compression costs over a horizon, and when a learned protocol is unique enough for a teammate to read. We answer them for rate-limited Dec-POMDPs, then measure how far reinforcement learning falls short of the optimum. Our theorems fix what is achievable independently of any learner, so a gap between an engineered and a learned sender at the same bit budget is an optimization fact, not an information-theoretic one. We instantiate this on three MuJoCo arenas spanning zero, partial and rigid physical coupling, charging every condition exactly 2 bits per decision, and create the discriminating regime by closing a physical side channel within one arena, holding bodies, task and reward fixed. Communication value is governed by coupling: under rigid coupling through a shared object, no channel beats silence (+0.001 +/- 0.001, p = 0.982, n = 25), since proprioception already carries that information; without coupling, every condition solves the task; under partial coupling, the engineered 2-bit sender reaches an interquartile mean of 1.000 but the learned one reaches 0.482, indistinguishable from silence (p = 0.400, n = 25). With a shared alphabet, bandwidth cannot explain the gap. Warm-starting from an engineered receiver localizes the failure: the same channel reaches 0.857 versus 0.562 cold-started (p < 0.001), so it is neither representational nor one of maintenance; reinforcement learning fails to discover the protocol. Cross-play shows learned protocols are individually meaningful but mutually unintelligible: self-play 0.980 collapses to 0.144 across seeds, and our best constructed alignment leaves at least 77% of that gap. All headline results use 25 seeds per arena and seven published baselines at matched rate.