Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces VeRe-Flow, a novel framework for noise-robust bandwidth expansion that enhances the reconstruction of high-fidelity wideband speech from low-resolution, noisy inputs. By employing multi-level clean supervision, the method utilizes velocity contrastive regularization to refine velocity estimation and representation alignment to ensure intermediate features align with clean representations. The results indicate that VeRe-Flow outperforms existing methods, achieving the lowest Log-Spectral Distortion (LSD) and highest DNS Mean Opinion Score (DNSMOS) Overall, alongside the best Mean Opinion Score (MOS) among generative approaches.
Achieving the best clean speech reconstruction yet, VeRe-Flow leverages innovative velocity contrastive regularization to navigate the noise-induced ambiguity in speech generation.
Noise-robust bandwidth expansion aims to reconstruct high-fidelity wideband speech from noisy low-resolution inputs. While flow matching has shown strong performance in speech generation, accurately recovering clean speech from noisy inputs remains challenging due to the ambiguity of velocity estimation under noise. In this work, we propose VeRe-Flow, a clean-guided flow matching framework that introduces multi-level clean supervision to guide the generative process toward clean speech. At the velocity level, we introduce velocity contrastive regularization, which attracts the predicted velocity toward the clean trajectory while repelling it from noisy trajectories. At the representation level, we incorporate representation alignment that aligns intermediate features with clean self-supervised learning representations. The results demonstrate that the proposed method achieves the lowest LSD and highest DNSMOS OVRL among all baselines, and the highest MOS among generative baselines.