Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates how NCSN++ U-Net audio dereverberation models encode room characteristics in their intermediate layers, revealing that deeper layers capture structured room impulse response (RIR)-dependent embeddings. The research finds a strong correlation between the discriminative ability of these implicit representations and the models' dereverberation performance across various metrics. By introducing a training strategy that conditions the network on pre-trained RIR embeddings through self-supervised contrastive learning, the authors demonstrate improved representation quality and performance, alongside a reduction in the reverse diffusion steps needed during inference.
Conditioning U-Net models on pre-trained room impulse response embeddings can dramatically enhance dereverberation performance while streamlining inference.
In this work, we analyze the ability of NCSN++ U-Net based audio dereverberation models to capture global room characteristics in their intermediate representations. Through an empirical study of both a state-of-the-art diffusion-based model and a discriminative counterpart, we show that deeper layers encode structured room impulse response (RIR)-dependent embeddings. Moreover, the discriminative ability of this implicit room representation correlates with dereverberation performance across objective metrics. Motivated by this observation, we propose a training strategy that explicitly conditions the network on pre-trained RIR embeddings, obtained via self-supervised contrastive learning. Incorporating RIR conditioning improves representation quality, accelerates convergence, and enhances dereverberation performance, while significantly reducing the number of reverse diffusion steps required by the diffusion-based model during inference.