Search papers, labs, and topics across Lattice.
BASENet introduces a frequency-adapted architecture for speech enhancement that utilizes a Bark-scale band partitioning to assign varying capacities to different frequency bands based on human auditory perception. This method employs a cross-band attention module to effectively capture harmonic dependencies while maintaining linear complexity. Achieving a PESQ score of 3.55 with only 0.83M parameters, BASENet outperforms existing models in efficiency and effectiveness, making it suitable for real-time applications on resource-constrained devices.
BASENet achieves state-of-the-art speech enhancement with the fewest parameters, demonstrating that efficient design can outperform traditional models in both quality and resource usage.
Speech enhancement models typically apply uniform capacity across all frequencies, disregarding the non-uniform spectral resolution of human hearing. We propose BASENet, a frequency-adapted architecture that partitions the spectrum into Bark-scale bands and assigns each a scaled-capacity encoder derived from critical-band density, automatically granting deeper branches to perceptually dense low frequencies and lighter ones to high frequencies. A cross-band attention module captures harmonic dependencies across bands through compact frequency-pooled representations at linear complexity. Built on inverted residual blocks with dense connectivity and a convolutional recurrent network, BASENet achieves 3.55 PESQ and STOI~96% on VoiceBank+DEMAND with only 0.83M parameters and 7.3 G~MACs, the fewest parameters among all methods with PESQ > 3.50. A causal variant (3.44 PESQ) surpasses several non-causal baselines, confirming suitability for real-time streaming on resource-constrained devices.