Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces LaCo-SENet, a novel approach to streaming speech enhancement that allows for configurable latency through asymmetric temporal padding and dual-buffer streaming. By utilizing a single hyperparameter during training, the model effectively balances the trade-off between latency and audio quality, achieving a range of operational latencies from 12.5 ms to 75.0 ms. The results demonstrate that at the lowest latency of 12.5 ms, LaCo-SENet achieves a PESQ score of 3.35, surpassing the previous causal state-of-the-art score of 3.27 at a much higher latency of 46.5 ms.
Configurable latency in speech enhancement can now achieve state-of-the-art quality without compromising speed, challenging the traditional binary approach.
Streaming speech enhancement requires balancing algorithmic latency against quality, yet existing approaches largely treat this as a binary causal versus non-causal choice. LaCo-SENet addresses this issue with two mechanisms parameterized by a single training-time hyperparameter. First, asymmetric temporal padding redistributes past and future context in convolutions, enabling systematic latency configuration. Second, dual-buffer streaming combines state buffers for past context with lookahead buffers that supply future context at both the input and feature levels. Selective state updates also prevent future-frame leakage into the streaming state, ensuring training-inference consistency. On VoiceBank+DEMAND, a fixed-budget (1.37M parameters) backbone yields a family of models spanning 12.5-75.0 ms, with PESQ rising from 3.35 to 3.43. At just 12.5 ms (fully causal), a PESQ of 3.35 matches or exceeds the prior causal state-of-the-art (3.27 at 46.5 ms).