Search papers, labs, and topics across Lattice.
This study addresses the task-oriented formation decision problem in multi-robot systems, particularly focusing on herding tasks where defenders must counter agile attackers. By encoding formation shapes as low-dimensional parameter vectors, the authors reformulate the formation decision into a parameter optimization problem, allowing for dynamic adaptation to task requirements. The reinforcement learning-based policy developed for regulating these parameters shows significant effectiveness in simulations and real-world deployments, outperforming existing baselines in handling adversarial unpredictability.
Encoding formation shapes as low-dimensional vectors enables dynamic adaptation, allowing defenders to outmaneuver unpredictable attackers in herding tasks.
Multi-robot systems can accomplish tasks that are difficult for a single robot by organizing into task-specific formations. Different from existing studies on multi-robot shape formation, we here study the task-oriented formation decision problem, with a focus on the herding task. This task is challenging due to the attackers'superior maneuverability and their unknown strategies. To address these challenges, we propose the following novel results. First, we encode the formation shape using a low-dimensional parameter vector. This parametric representation reformulates the formation decision as a parameter optimization problem, thereby resolving the limited flexibility of predefined shapes. By optimizing these formation parameters, the defenders'maneuverability disadvantage is mitigated through a formation shape that continuously adapts to task requirements. Second, we develop a reinforcement learning-based policy to regulate the formation parameters. Trained offline in simulations covering diverse attacking strategies, the learned policy can effectively handle adversarial unpredictability during online deployment. Comparative simulations against three baselines demonstrate that our method can successfully accomplish challenging herding tasks. Additional scalability simulations further verify its applicability to simulated scenarios involving dozens of robots. We also validate the practical feasibility of our method on a physical robotic platform with 3 attackers and 7 defenders.