Search papers, labs, and topics across Lattice.
This paper introduces a novel framework that integrates multi-agent reinforcement learning (MARL) with model-based control to enhance cooperative strategies in multi-agent tasks. By developing the multi-agent actor-critic model predictive control (MA-AC-MPC) algorithm, the authors achieve safe and dynamically feasible actions, outperforming traditional methods in both simulation and hardware applications. The results show a significant improvement in success rates, with MA-AC-MPC achieving 100% success in a cooperative landing task compared to 60% with a multi-layer perceptron model.
MA-AC-MPC outperforms traditional models, achieving a perfect success rate in cooperative tasks while ensuring safety and feasibility in dynamic environments.
In this work, we propose a framework that combines multi-agent reinforcement learning (MARL) with model-based control to achieve safe, dynamically feasible actions in cooperative multi-agent tasks. Multi-agent reinforcement learning provides the advantage of learning cooperative policies for multi-agent teams from discrete non-differentiable rewards in a long planning horizon. Model-predictive control is robust and offers safe, dynamically feasible actions in a fast replanning framework for short horizons. We propose an algorithm that extends actor-critic model predictive control for MARL which we refer to as multi-agent actor-critic model predictive control (MA-AC-MPC). We demonstrate the capabilities of this algorithm by applying it to a multi-agent pursuit-evasion scenario. Specifically, we compare the evader team's strategy using the MA-AC-MPC model and a multi-layer perceptron model (MA-AC-MLP). The pursuer team uses augmented proportional navigation as it is accepted as an advanced adversarial control law. We also provide an example with a heterogeneous environment where a drone and omni-wheeled rover cooperate to achieve repeatable and successful landing with 100% success rate in hardware for MA-AC-MPC compared to 60% for MA-AC-MLP. We demonstrate the robustness of the proposed MA-AC-MPC algorithm in hardware for both environments.
