Search papers, labs, and topics across Lattice.
This paper introduces Automatic Contextual Audio Denoising (ACAD), a novel approach that dynamically defines target sounds and noise based on inferred acoustic scene context. They train a deep learning model to infer the acoustic scene and selectively remove out-of-context (OC) sound events, treating them as noise. Experiments on diverse datasets demonstrate that ACAD outperforms context-agnostic methods and those with uninformative context, achieving superior denoising performance by leveraging contextual understanding.
Context-aware audio denoising can outperform traditional methods by intelligently removing sounds irrelevant to the inferred acoustic scene, even if those sounds would be considered relevant in a different context.
Audio context determines which sound components and sources are relevant and which can be perceived as irrelevant (noise) by listeners. For example, traffic noise is informative in urban surveillance but noise for a phone call at the same location. Most current audio denoising systems apply fixed target-noise definitions, often removing useful components in one context while failing to suppress irrelevant components. To address this, we introduce the concept automatic contextual audio denoising (ACAD) which defines target and noise based on the inferred context. In this work, we restrict context to be associated with an acoustic scene class. We label sound events outside the event distribution of a scene class (noise) as out-of-context (OC) and events typical for that scene as in-context (IC). We implement a deep learning method that automatically infers the context of the audio signal and removes OC components, and benchmark it against variants: without context inference, with oracle context, and with separately provided uninformative context. On paired clean/noisy data across diverse contexts, where OC components in one context may be IC in another, our proposed method outperforms other approaches across standard objective metrics, indicating that the model can infer context and context-dependent processing can enhance denoising.
