Search papers, labs, and topics across Lattice.
This paper introduces SE-AGCNet, an innovative end-to-end framework that simultaneously enhances speech quality and controls loudness in meeting scenarios, addressing the limitations of conventional audio processing pipelines. By jointly optimizing speech enhancement (SE) and automatic gain control (AGC), the framework effectively preserves low-volume speech while ensuring appropriate volume adjustments, overcoming the pitfalls of traditional sequential approaches. Experimental results demonstrate that SE-AGCNet not only meets target loudness levels but also significantly improves speech quality and automatic speech recognition (ASR) accuracy compared to existing methods.
Jointly optimizing speech enhancement and loudness control can dramatically improve audio clarity and ASR performance in dynamic meeting environments.
Conventional audio pipelines typically treat speech enhancement (SE) and automatic gain control (AGC) as discrete modules, which often limits overall performance. For instance, applying AGC before SE may inadvertently amplify background noise, while prioritizing SE tends to over-suppress low-volume speech. To address these limitations, we propose SE-AGCNet, an end-to-end framework that jointly optimizes SE and AGC. Tailored for meeting scenarios with significant volume variations, SE-AGCNet leverages the synergy between the two tasks: SE preserves quiet speech, thereby facilitating effective volume adjustment by the AGC component. Furthermore, we propose a specialized data simulation pipeline, SE-AGC-DataGen, and incorporate standardized loudness evaluation metrics: integrated loudness (LUFS), short-term loudness (St LUFS), and LRA. Experiments show that SE-AGCNet consistently achieves target loudness while improving speech quality and ASR accuracy over competitive baselines.
