Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces audio diarization, a novel task aimed at detecting and localizing sound events in unknown environments without prior knowledge of event classes. By adapting speaker diarization techniques, the authors demonstrate that their approach can effectively identify onset and offset times of overlapping sound events, achieving performance comparable to traditional closed-set sound event detection systems while also accommodating novel sounds. The findings highlight the potential for audio diarization to enhance audio monitoring applications where the sound landscape is unpredictable.
Audio diarization can detect and classify unknown sound events in real-time, outperforming traditional systems in dynamic environments.
We propose a new task, audio diarization. The motivation is that there are applications, such as audio monitoring in an unknown environment, where initially the sound event classes to be recognized are unknown. For such a scenario, we propose to first localize in time relevant sound events and to classify them, e.g., by comparing with known event classes, in a second step. This contribution is dedicated to the first step, which we call audio diarization, as it is reminiscent of the speaker diarization stage that precedes and simplifies the second stage, speech recognition, in multi-talker conversational speech processing. In this contribution, we define audio diarization as detecting onset and offset times of sound events with overlap for an open set of classes and without user prompts. We show how a speaker diarization system can be adjusted for audio diarization and propose an evaluation setup. Compared to a closed-set sound event detection system, the proposed system achieves similar performance with the additional ability to detect novel sounds.