Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces a novel modulation tensorgram representation that retains the temporal dynamics of audio signals from honey bee colonies, which were previously overlooked in acoustic monitoring. By employing convolutional and convolutional recurrent deep neural networks on a dataset of over 3,000 hours of beehive recordings, the authors demonstrate significant improvements in accuracy and cross-hive generalizability compared to traditional methods. The findings indicate that this approach not only enhances monitoring capabilities but also offers robustness against noisy environmental conditions, crucial for effective hive management.
Retaining temporal dynamics in audio analysis boosts honey bee colony monitoring accuracy and robustness, revealing insights previously lost in traditional methods.
Honey bees (Apis mellifera) play a crucial role in agriculture and ecosystem stability as key pollinators of crops and wild plants. As such, monitoring hive strength remotely with Internet of Things (IoT) sensors has become a crucial task. Previously, handcrafted features extracted from the modulation spectrum of audio IoT devices were shown to improve acoustic monitoring of colony strength. In this paper, we hypothesize that important discriminative information is present in the temporal dynamics of the modulation spectrum, but this information is discarded with prior methods. As such, we explore the use of a new modulation tensorgram where the time dimension is kept. This new representation is used as input to a convolutional neural network (CNN) and a convolutional recurrent deep neural networks (CRDNN). Using the public UrBAN dataset, which contains more than 3,000 hours of beehive audio recordings, we show that the proposed method improves both accuracy and cross-hive generalizability over prior benchmark methods, and the results further suggest improved robustness to noisy in-the-wild recording conditions. We use saliency maps and gradient-weighted class activation maps for explainability and show the importance of the modulation spectral temporal dynamics for the task at hand. Overall, our results suggest that accurate, generalizable, and robust acoustic monitoring of honey bee colony strength is possible.