Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to audio source separation in reverberant environments by integrating nonnegative factorization (NMF) with Gaussian model-based multichannel separation. The method estimates source spectral variances and spatial covariance matrices using NMF based on prior information about source variances, optimized via minimizing β-divergence. Experimental results demonstrate that controlling the sparsity of the factorization significantly improves separation performance compared to existing algorithms.
Sparsity, not β-divergence, is the key to unlocking better audio source separation in reverberant environments.
In Gaussian model-based multichannel audio source separation, the likelihood of observed mixtures of source signals is parametrized by source spectral variances and by associated spatial covariance matrices. These parameters are estimated by maximizing the likelihood through an expectation-maximization algorithm and used to separate the signals by means of multichannel Wiener filtering. We propose to estimate these parameters by applying nonnegative factorization based on prior information on source variances. In the nonnegative factorization, spectral basis matrices can be defined as the prior information. The matrices can be either extracted or indirectly made available through a redundant library that is trained in advance. In a separate step, applying nonnegative tensor factorization, two algorithms are proposed in order to either extract or detect the basis matrices that best represent the power spectra of the source signals in the observed mixtures. The factorization is achieved by minimizing the <inline-formula><tex-math notation="LaTeX">$\beta$</tex-math></inline-formula>-divergence through multiplicative update rules. The sparsity of factorization can be controlled by tuning the value of <inline-formula> <tex-math notation="LaTeX">$\beta$</tex-math></inline-formula>. Experiments show that sparsity, rather than the value assigned to <inline-formula><tex-math notation="LaTeX">$\beta$</tex-math></inline-formula> in the training, is crucial in order to increase the separation performance. The proposed method was evaluated in several mixing conditions. It provides better separation quality with respect to other comparable algorithms.