Search papers, labs, and topics across Lattice.
This paper introduces the Dual-Branch Hybrid Neural (DBHN) Network, which integrates artificial neural networks (ANNs) and spiking neural networks (SNNs) to enhance monaural speech while significantly reducing computational complexity. By employing a dual-branch architecture with specialized modules for energy consumption and information retention, the model achieves a remarkable 7.5-fold reduction in computational complexity without sacrificing performance. The results demonstrate that the DBHN Network outperforms existing methods across three public datasets, highlighting its potential for practical applications in low-complexity speech enhancement tasks.
Achieving a 7.5-fold reduction in computational complexity, the DBHN Network outperforms traditional methods in monaural speech enhancement while maintaining high performance.
Although artificial neural network (ANN) based speech enhancement (SE) methods demonstrate excellent performance, the high computational complexity and high energy consumption hinder their deployment in practical front-end processing tasks.} Currently, the spiking neural networks (SNNs) have shown potential in reducing power consumption. However, the discrete binary activation and complex spatio-temporal dynamics of SNNs often result in information loss. The current challenge therefore focuses on how to maintain performance and reduce computational complexity. To address this issue, this work propose a Dual-Branch Hybrid Neural (DBHN) Network. 1) In terms of network architecture: A dual-branch network integrating ANN and SNN was designed, where the SNN branch reduces power consumption while the ANN branch addresses information loss; The BandSplit and Time-Frequency (TF) -Mamba modules were developed to simultaneously compress energy consumption and enhance model performance; Spiking Feature Extraction Group (SFEG) and Information Transformation Block (ITB) components were implemented with residual connections to mitigate information loss while further refining feature representations. 2) To facilitate inter-branch information fusion: An Interaction module was designed to promote information exchange at various stages of the dual-branch network; A TF-Cross Attention-Fusion module was designed to perform time-frequency domain fusion of dual-branch information while data-adaptively guiding the SNN branch to retain more critical information. Results show that the proposed model maintains superior performance across three public datasets while achieving an average 7.5 fold reduction in computational complexity compared to baseline models.
