Search papers, labs, and topics across Lattice.
The authors introduce FR-GESTURE, a novel RGBD dataset designed for gesture-based control of Unmanned Ground Vehicles (UGVs) by First Responders (FRs). The dataset comprises 3312 RGBD pairs captured from two viewpoints and seven distances, featuring 12 gesture commands inspired by existing FR hand signals. Baseline experiments and evaluation protocols are provided to facilitate future research in this domain.
A new RGBD dataset tailored for gesture-controlled robots in first responder scenarios promises to improve human-robot collaboration in disaster relief.
The ever increasing intensity and number of disasters make even more difficult the work of First Responders (FRs). Artificial intelligence and robotics solutions could facilitate their operations, compensating these difficulties. To this end, we propose a dataset for gesture-based UGV control by FRs, introducing a set of 12 commands, drawing inspiration from existing gestures used by FRs and tactical hand signals and refined after incorporating feedback from experienced FRs. Then we proceed with the data collection itself, resulting in 3312 RGBD pairs captured from 2 viewpoints and 7 distances. To the best of our knowledge, this is the first dataset especially intended for gesture-based UGV guidance by FRs. Finally we define evaluation protocols for our RGBD dataset, termed FR-GESTURE, and we perform baseline experiments, which are put forward for improvement. We have made data publicly available to promote future research on the domain: https://doi.org/10.5281/zenodo.18131333.
