Search papers, labs, and topics across Lattice.
This paper introduces Sky-Ear, a UAV-based system for victim sound detection and localization in SAR missions, addressing on-board hardware constraints through energy-efficient acoustic sensing. Sky-Ear employs a two-stage audio processing approach: a Sentinel stage using a masking autoencoder (MAE) for initial sound detection, followed by a Responder stage for increased reliability. The system then refines localization accuracy by optimizing detected directions from multiple UAV observations.
A masking autoencoder can enable energy-efficient and accurate sound detection on UAVs for search and rescue, potentially saving lives.
Unmanned Aerial Vehicles (UAVs) are increasingly deployed in search-and-rescue (SAR) missions, yet continuous and reliable victim detection and localization remain challenging due to on-board hardware constraints. This paper designs an UAV-Enabled Victim Sound Detection and Localization System (called ``Sky-Ear''for brevity) to achieve energy-efficient acoustic sensing and sound detection for SAR. Based on a circular-shaped microphone array, two-stage (Sentinel and Responder) audio processing is developed for energy-consuming and highly reliable sound detection. A Masking autoencoder (MAE)-based sound detection method is designed in the Sentinel stage to analyze frequency-time acoustic features. For improved precision, a continuous localization method is designed by optimizing detected directions from multiple observations. Extensive simulation experiments are conducted to validate the system's performance in terms of victim detection accuracy and localization error.