Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of intercepting an agile drone using a team of net-carrying drones, framing it as a competitive Multi-Agent Reinforcement Learning (MARL) problem. By employing Multi-Agent Proximal Policy Optimization (MAPPO) combined with Prioritized Fictitious Self Play (PFSP), the authors effectively mitigate nonstationarity and catastrophic forgetting, leading to robust policies that adapt to varying opponent strategies. The results demonstrate a significant improvement in catch rate and time to catch compared to heuristic baselines, with qualitative analyses revealing the emergence of cooperative tactics among pursuers.
Robust policies trained with PFSP enable net-carrying drones to adaptively intercept agile targets, outperforming traditional heuristics in pursuit-evasion scenarios.
This article presents a solution to intercept an agile drone by a team of agile drone carrying catching nets. We formulate the problem as a competitive Multi-Agent Reinforcement Learning (MARL) task. To address the problem of nonstationarity and catastrophic forgetting of agents overfitting to the current opponent strategy, we train the pursuers and the evader using Multi-Agent Proximal Policy Optimization (MAPPO) with Prioritized Fictitious Self Play (PFSP). We train the agents in a high-fidelity simulator using low-level control commands, collective thrust and body rates (CTBR), to achieve agile flights for both the pursuers and the evader. We compare the performance of the trained policies in terms of catch rate, time to catch and crash rates, against heuristic baselines and show that our solution outperforms them. Ablation studies show that PFSP lead to more robust policies that can adapt to different opponent strategies, and that a low-level control commands are crucial for learning performing strategies in the pursuit-evasion task. Finally, a qualitative analysis of the learned behaviours highlights the emergence of cooperative tactics among the pursuers.