Search papers, labs, and topics across Lattice.
This paper introduces a deep reinforcement learning framework using Proximal Policy Optimization (PPO) to guide fish schools via virtual agents in a closed-loop system. The agents, trained in simulation, interact in real-time with rummy-nose tetras in physical experiments, using a composite reward function balancing directional guidance and social cohesion. Results show effective guidance for small groups (n=5), but performance degrades with larger groups (n=8), highlighting the challenges of maintaining influence in larger biological collectives.
Turns out, even with RL, herding fish is harder than it looks: guidance efficacy plummets as school size increases.
Guiding collective motion in biological groups is a fundamental challenge in understanding social interaction rules and developing automated systems for animal management. In this study, we propose a deep reinforcement learning (RL) framework for the closed-loop guidance of fish schools using virtual agents. These agents are controlled by policies trained via Proximal Policy Optimization (PPO) in simulation and deployed in physical experiments with rummy-nose tetras (Petitella bleheri), enabling real-time interaction between artificial agents and live individuals. To cope with the stochastic behavior of live individuals, we design a composite reward function to balance directional guidance with social cohesion. Our systematic evaluation of visual parameters shows that a white background and larger stimulus sizes maximize guidance efficacy in physical trials. Furthermore, evaluation across group sizes revealed that while the system demonstrates effective guidance for groups of five individuals, this capability markedly degrades as group size increases to eight. This study highlights the potential of deep RL for automated guidance of biological collectives and identifies challenges in maintaining artificial influence in larger groups.
