Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a modular execution-stage state-estimation layer, Decoupled Delay Compensation (DDC), to improve the robustness of pre-trained MARL policies under communication delays and packet loss. DDC uses a learned Gated transition model and recursive Kalman filtering to estimate current states from asynchronous observations. Experiments across various MARL benchmarks show that DDC consistently enhances performance, particularly in coordination-intensive and dynamically unstable tasks, without requiring retraining of the original policies.
Plug-and-play Kalman filtering can rescue pre-trained MARL policies from communication delays and packet loss, boosting performance without retraining.
Real-world multi-agent reinforcement learning (MARL) systems must often operate under stale observations, stochastic communication delays, and intermittent packet loss. Policies trained under idealized synchronous conditions frequently exhibit significant performance degradation in these regimes because they act on outdated feedback. We propose a modular execution-stage state-estimation layer that replaces delayed communicated observations with current belief-state estimates. The framework integrates a learned Gated transition model with a recursive Kalman filtering layer to estimate instantaneous states from asynchronous measurements. A primary advantage of this approach is its modularity, The estimator serves as a plug-in for pre-trained policies, requiring no modifications to the original MARL training algorithm, architecture, or reward structure. Evaluation across diverse multi-agent and continuous-control benchmarks demonstrates that the proposed layer consistently enhances robustness to communication latency and message loss. The most significant performance gains are observed in coordination-intensive and dynamically unstable tasks where temporal consistency is critical for control.