Search papers, labs, and topics across Lattice.
This paper tackles the challenge of training and deploying multi-agent reinforcement learning policies for real-world robot teams engaged in both cooperative and competitive tasks. They introduce a comprehensive robotic system with simulation, a distributed learning framework, and physical robots. To improve sim-to-real transfer, they propose Out of Distribution State Initialization (OODSI), which leads to a 20% performance boost in real-world experiments involving a competitive multi-robot car game and a cooperative task.
Close the sim-to-real gap in multi-agent robotics by initializing training with states outside the expected distribution, boosting real-world performance by 20%.
Multi-agent deep Reinforcement Learning (RL) has made significant progress in developing intelligent game-playing agents in recent years. However, the efficient training of collective robots using multi-agent RL and the transfer of learned policies to real-world applications remain open research questions. In this work, we first develop a comprehensive robotic system, including simulation, distributed learning framework, and physical robot components. We then propose and evaluate reinforcement learning techniques designed for efficient training of cooperative and competitive policies on this platform. To address the challenges of multi-agent sim-to-real transfer, we introduce Out of Distribution State Initialization (OODSI) to mitigate the impact of the sim-to-real gap. In the experiments, OODSI improves the Sim2Real performance by 20%. We demonstrate the effectiveness of our approach through experiments with a multi-robot car competitive game and a cooperative task in real-world settings.
