Search papers, labs, and topics across Lattice.
This paper introduces MeCo, a one-step generative corrector for multi-channel speech separation that leverages a MeanFlow-based approach to enhance human listening quality. By employing Data-Space Optimization (DSO) and a novel $\mathbf{x}_r$-loss, MeCo effectively maps discriminative estimates to the clean speech manifold, optimizing both signal fidelity and perceptual quality. Experimental results show that MeCo achieves state-of-the-art performance with minimal computational overhead, outperforming existing methods in various scenarios.
Achieving superior human listening quality in speech separation without sacrificing computational efficiency could redefine standards in audio processing.
While discriminative models for multi-channel speech separation excel in reference-based metrics, they often exhibit suboptimal human listening quality. To address this, we propose a novel MeanFlow-based one-step generative corrector (MeCo). MeCo learns a conditional average velocity field to map discriminative estimates directly onto the clean speech manifold in a single step. To maximize one-step generation performance, we introduce Data-Space Optimization (DSO). DSO integrates an $\mathbf{x}_r$-loss, which penalizes prediction errors on longer displacement intervals to serve as a generative objective for human listening quality, with an Endpoint SI-SDR loss that directly optimizes terminal signal fidelity. Experiments demonstrate that MeCo achieves state-of-the-art (SOTA) performance with minimal computational overhead, simultaneously achieving superior signal fidelity and human listening quality in both in-domain and out-of-domain scenarios.
