Search papers, labs, and topics across Lattice.
This paper introduces LMPAN, a lightweight multi-path alignment network designed for joint acoustic echo cancellation (AEC) and noise suppression (NS) in full-duplex spoken dialogue systems. By implementing a multi-path alignment stage, an attention-based feature integration mechanism, and a dynamic post-filtering module, LMPAN effectively addresses hardware distortions and varying acoustic conditions. Experimental results demonstrate that LMPAN achieves state-of-the-art performance with significantly lower resource requirements, maintaining real-time inference capabilities.
Achieving state-of-the-art acoustic echo cancellation and noise suppression with only 480K parameters, LMPAN redefines efficiency in spoken dialogue systems.
We propose a lightweight multi-path alignment network (LMPAN) for on-device joint acoustic echo cancellation (AEC) and noise suppression (NS) in full-duplex spoken dialogue systems. To address hardware-induced distortions and dynamic acoustic conditions, we introduce three core innovations: (1) a multi-path alignment stage correcting temporal and energy mismatches across reference, linear AEC (LAEC) output, and microphone signals; (2) an attention-based mechanism that dynamically integrates enhanced LAEC and microphone features under varying acoustic scenarios; (3) a post-filtering module with a dynamic target generation strategy for downstream tasks (ASR, VAD). Furthermore, we adopt a two-stage training framework leveraging self-supervised learning representations to enhance perceptual quality. Experiments show that LMPAN, with only 480K parameters and 126 MACs, achieves performance comparable to the state-of-the-art lightweight model DeepVQE-S, while ensuring real-time inference capability.
