Search papers, labs, and topics across Lattice.
This paper introduces a novel Parallel Time-Band Mixer (PTBM) for speech enhancement that eliminates recurrent unrolling, enhancing parallel efficiency in automatic speech recognition (ASR) front-ends. By integrating intra-band temporal mixing and per-frame cross-band attention, the PTBM enables effective contextual modeling across time and frequency without the need for extensive tuning. Experimental results demonstrate that this approach significantly reduces word error rates compared to traditional recurrent methods while maintaining a lightweight architecture with minimal parameters and computational requirements.
Achieving robust ASR with a front-end that reduces word error rates while using fewer than 1 million parameters and minimal computational overhead is a game changer for speech processing efficiency.
Speech enhancement is often used as a front-end for robust ASR, yet recurrent temporal and cross-band modules introduce sequential dependencies that reduce parallel efficiency. In this paper, we present a sequence-parallel band-split enhancement front-end built on a Parallel Time-Band Mixer (PTBM) block that eliminates within-block recurrent unrolling. PTBM integrates intra-band temporal mixing and per-frame cross-band attention within a unified parallel architecture, enabling efficient contextual modeling across both time and frequency dimensions. The system retains the mask-plus-residual reconstruction interface and introduces learned Observation-Adding (LOA) to suppress ASR-sensitive artifacts without development-set tuning. Experiments on DNS Challenge and CHiME-4 with frozen Whisper back-ends show that the proposed front-end consistently reduces word error rate relative to recurrent band-split baselines while requiring only 0.96 M parameters and 0.58 GMAC/s for the front-end network.
