Search papers, labs, and topics across Lattice.
This paper presents a novel sim-to-real transfer method for multi-agent control that addresses the challenges posed by dynamics mismatch through a technique called effect alignment. By elevating policy learning to a semantic abstraction level and incorporating an action synchronization mechanism, the approach enhances temporal consistency and robustness in complex environments. Experimental results across four multi-agent navigation tasks reveal significant improvements in training efficiency and success rates in real-world applications compared to traditional transfer methods.
Effect alignment allows multi-agent systems to thrive in real-world scenarios despite dynamics mismatch, significantly boosting training efficiency and success rates.
Complex multi-agent control tasks remain challenging for traditional rule-based and model-based approaches, motivating the adoption of learning-based methods. However, learning-based methods often struggle with sim-to-real transfer because they rely on accurate dynamics modeling or system identification and learn policies in low-level control spaces that are highly sensitive to dynamics mismatch, making them costly and fragile in complex environments. To address this issue, we propose a sim-to-real method for multi-agent control, which is insensitive to dynamics mismatch via effect alignment. Our method combines random environmental structure with discrete semantic actions through closed-loop control, elevating policy learning to a semantic abstraction level. Additionally, we develop an action synchronization mechanism that mitigates inter-agent action timing mismatches, thereby enhancing the temporal consistency of the system. Experiments on four multi-agent navigation tasks demonstrate that our method substantially improves training efficiency over mainstream transfer methods and achieves higher success rates in real-world scenarios, thereby improving the robustness and deployment stability of multi-agent systems under dynamics mismatch.
