Search papers, labs, and topics across Lattice.
RT-Tango introduces a novel real-time distributed binaural speech enhancement framework tailored for low-power hearing aids, addressing critical challenges of latency and computational efficiency. The framework employs a two-stage architecture that integrates perceptually motivated ERB feature compression and lightweight recurrent mask estimation, achieving significant reductions in computational cost. Experimental results demonstrate that RT-Tango not only meets stringent latency requirements with delays as low as 8 ms but also maintains competitive speech enhancement performance.
Achieving ultra-low latency of 8 ms, RT-Tango redefines binaural speech enhancement for hearing aids without sacrificing performance.
Real-time binaural speech enhancement is constrained by latency, computational cost, and inter-device communication, yet existing efficient solutions predominantly address single-channel settings. In this paper, we introduce RT-Tango, a real-time distributed binaural speech enhancement framework designed for streaming on resource-constrained platforms and specifically for hearing aids. RT-Tango relies on a two-stage distributed architecture combining perceptually motivated ERB feature compression, lightweight grouped recurrent mask estimation, and temporal sparsification to reduce computational cost. Stringent latency constraints are addressed by decoupling spectral resolution from algorithmic delay using an asymmetric STFT, together with causal recurrent inference and online estimation of spatial statistics. Experimental results show that RT-Tango achieves competitive speech enhancement while significantly reducing MACs operations and functioning at ultra-low latencies as low as 8 ms.
