Search papers, labs, and topics across Lattice.
This paper tackles the challenge of controlling autonomous underwater vehicles (AUVs) for reef monitoring under uncertain conditions by using reinforcement learning. They propose a contextual multi-task RL approach to learn control policies that generalize across different monitoring tasks (e.g., detecting different species) and environmental conditions. Experiments in a simulated reef environment (HoloOcean) demonstrate improved sample efficiency, zero-shot generalization to new tasks, and robustness to varying water currents compared to single-task RL.
Contextual multi-task reinforcement learning enables autonomous underwater vehicles to nimbly adapt to diverse reef monitoring tasks and turbulent underwater conditions, paving the way for more sustainable marine ecosystem observation.
Although autonomous underwater vehicles promise the capability of marine ecosystem monitoring, their deployment is fundamentally limited by the difficulty of controlling vehicles under highly uncertain and non-stationary underwater dynamics. To address these challenges, we employ a data-driven reinforcement learning approach to compensate for unknown dynamics and task variations.Traditional single-task reinforcement learning has a tendency to overfit the training environment, thus, limit the long-term usefulness of the learnt policy. Hence, we propose to use a contextual multi-task reinforcement learning paradigm instead, allowing us to learn controllers that can be reused for various tasks, e.g., detecting oysters in one reef and detecting corals in another. We evaluate whether contextual multi-task reinforcement learning can efficiently learn robust and generalisable control policies for autonomous underwater reef monitoring. We train a single context-dependent policy that is able to solve multiple related monitoring tasks in a simulated reef environment in HoloOcean. In our experiments, we empirically evaluate the contextual policies regarding sample-efficiency, zero-shot generalisation to unseen tasks, and robustness to varying water currents. By utilising multi-task reinforcement learning, we aim to improve the training effectiveness, as well as the reusability of learnt policies to take a step towards more sustainable procedures in autonomous reef monitoring.
