Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DAR-Net, a transformer-based framework designed for recognizing diver activities in complex underwater environments, enhancing multi-human-robot collaboration. By employing a semantically guided learning approach that integrates temporal reasoning with pixel-level scene supervision, the framework effectively addresses the challenges posed by low visibility and data scarcity. The authors also present the Underwater Diver Activity (UDA) dataset, which includes over 2,600 annotated images, and demonstrate that DAR-Net significantly outperforms existing models in accurately classifying six diver activities.
DAR-Net not only sets a new benchmark for diver activity recognition but also introduces a groundbreaking dataset that could transform underwater robotics research.
Effective multi-human-robot collaboration is essential for expanding human-led operations in the challenging and high-risk underwater environment. For autonomous underwater vehicles (AUVs) to become true teammates, they must be able to comprehend their surroundings and recognize a diver's activities to offer assistance and ensure safety. Towards this goal, we introduce DAR-Net, a novel transformer-based framework that analyzes complex underwater scenes to classify diver activities. Our contribution lies in a semantically guided learning formulation that couples transformer-based temporal reasoning with pixel-level scene supervision. This multi-loss training strategy explicitly aligns global activity recognition with local human-robot interaction semantics, which is particularly critical in low-visibility underwater conditions. To address the significant challenge of data scarcity in this domain, we present the first-ever Underwater Diver Activity (UDA) dataset, a foundational resource containing over 2,600 annotated images with pixel-level masks. Through rigorous experimental evaluations in a controlled environment, we demonstrate that DAR-Net achieves promising accuracy in recognizing six distinct diver activities, outperforming state-of-the-art models. While this dataset provides a crucial baseline, our work serves as a pioneering step, laying the groundwork for future research and facilitating the development of more intelligent, collaborative underwater robotic systems.