Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The QC-GAN framework introduces a parameter-efficient approach to speech enhancement by integrating a Quaternion Conformer generator with MetricGAN-based training, effectively reducing layer parameters while maintaining interdependencies through the Hamilton product. This innovative design enables the model to achieve a high Perceptual Evaluation of Speech Quality (PESQ) score of 3.48 with only 0.89 million parameters, demonstrating performance on par with larger state-of-the-art models. Additionally, a smaller variant with 35,000 parameters outperformed conventional methods, showcasing the potential for significant efficiency gains in real-world applications.
Achieving high-fidelity speech enhancement with fewer than 1 million parameters, QC-GAN challenges the notion that bigger models are always better.
We propose a parameter-efficient speech enhancement framework, Quaternion Conformer GAN (QC-GAN), which combines a Quaternion Conformer generator with MetricGAN-based training. The Hamilton product encodes the magnitude and phase via structured weight sharing, reducing the number of layer parameters while preserving their interdependencies. A metric-learning discriminator was employed to maximize perceptual quality by optimizing the approximate perceptual evaluation scores. On the VoiceBank+DEMAND dataset, QC-GAN achieved a Perceptual Evaluation of Speech Quality (PESQ) score of 3.48 with only 0.89M parameters, delivering a performance comparable to state-of-the-art models at less than half their size. A 35K-parameter variant achieved a PESQ score of 3.23, surpassing conventional methods with significantly fewer parameters. Evaluation on the DNS-Challenge 3 dataset further confirmed generalization to real-world conditions.