Search papers, labs, and topics across Lattice.
TF-MossFormer introduces a novel time-frequency transformer architecture that integrates local and global attention mechanisms to enhance monaural speech separation. By employing a content-aware sliding-window attention mechanism, it dynamically adjusts receptive fields to improve local interactions while effectively modeling long-range dependencies. The model achieves significant performance gains, with SI-SDRi scores of 22.6, 24.0, and 24.4 dB on WSJ0-2Mix, surpassing previous methods with varying parameter sizes.
TF-MossFormer outperforms existing speech separation models by effectively balancing local and global context through innovative attention mechanisms.
Transformers with global attention capture long-range dependencies but can miss the fine-grained local continuity crucial for speech separation. We propose TF-MossFormer, a time-frequency transformer that combines local and global attention to jointly model short- and long-range contexts for monaural speech separation. At its core is a content-aware sliding-window attention mechanism that dynamically adapts receptive fields for stronger local interactions, avoiding the rigidity of static convolutions. Unlike time-domain chunk-based methods, TF-MossFormer leverages the 2D spectrogram to model structure along both time and frequency axes. Convolutional gating between attention layers further improves feature selection and information flow. TF-MossFormer achieves SI-SDRi of 22.6, 24.0, and 24.4 dB on WSJ0-2Mix with 5.9M, 16.9M, and 25.4M parameters, respectively, outperforming prior approaches.
