Search papers, labs, and topics across Lattice.
This study introduces PolyChirp, a novel approach for multi-species birdsong classification that utilizes low-power microcontrollers and neural processing units (NPUs) to monitor multiple bird species in real-time. By integrating biological expertise with automated dataset curation and neural architecture optimization, PolyChirp achieves robust classification of up to 10 species simultaneously, surpassing previous state-of-the-art methods limited to binary classification. The results indicate that PolyChirp maintains operational efficiency, fitting within the resource constraints of field sensors powered by a single battery charge for an entire breeding season.
Achieving robust multi-species birdsong classification on low-power hardware, PolyChirp can monitor up to 10 species simultaneously while conserving energy for an entire breeding season.
Recent progress in the field of TinyML has demonstrated that low-power hardware based on microcontrollers can achieve bird species monitoring in real time based on acoustic sensor data for an entire breeding period on a single battery charge. However, the state of the art on low-power microcontrollers was so far limited to binary classification of a single species. In contrast, real fauna monitoring deployments often target multiple species simultaneously. To address this challenge we develop PolyChirp, an approach combining biological domain expertise, automated dataset curation, neural architecture optimization and novel hardware to achieve multiclass bird species detection in the wild. PolyChirp is based on newly designed tiny multiclass models that leverage recent microcontrollers and hardware acceleration with a neural processing unit (NPU). We evaluate the predictive performance of these models, and we measure their computational performance -- memory footprint, latency, energy consumption -- on common microcontroller hardware. Our results demonstrate that PolyChirp not only outperforms state-of-the-art on single species binary classification, but also achieves robust classification of up to 10 species simultaneously, while still fitting with the resource envelope of a sensor that must remain operational in the field for a full season on a single battery charge.
