Search papers, labs, and topics across Lattice.
This paper explores the development of TANGO, a hybrid distributed binaural speech enhancement system that integrates neural mask estimation with spatial filtering, specifically focusing on low-precision inference to enable deployment on resource-constrained devices. Through post-training quantization and quantization-aware training, the authors analyze the impact of quantization errors on mask estimation and their propagation to spatial filtering, revealing that the latter effectively compensates for these errors. The resulting simplified model, MN-TANGO, achieves significant reductions in model size and computational complexity while maintaining performance, reaching 4.65 MMAC/s and 0.177 MB with INT8 quantization and ERB compression.
Quantization errors in speech enhancement models can be largely mitigated by robust spatial filtering, enabling efficient deployment on low-resource devices.
Neural network-based multichannel speech enhancement systems achieve strong enhancement performance, but their computational and memory requirements limit deployment on resource-constrained devices. This paper investigates low-precision inference for TANGO, a hybrid distributed binaural speech enhancement system combining neural mask estimation with spatial filtering. We evaluate post-training quantization and quantization-aware training for the neural components, and analyze how quantization errors in the mask estimators propagate through the downstream spatial filtering stage. Our analysis shows that, although quantization degrades intermediate mask estimates, the spatial filtering stage compensates for most quantization-induced errors. Leveraging this robustness, we simplify TANGO into MN-TANGO, reducing both model size and computational complexity while maintaining comparable final performance. By combining INT8 weight-and-activation quantization with ERB compression and grouped recurrent layers, the most compact MN-TANGO reaches 4.65 MMAC/s and 0.177 MB.
