Search papers, labs, and topics across Lattice.
This study introduces an SSL-AutoEncoder (SSL-AE) approach that effectively reduces the dimensionality of high-dimensional speech representations while preserving performance in dysarthric Automatic Speech Recognition (ASR). By applying a bottlenecking technique, the method achieves an 8x reduction in training time compared to traditional SSL models, all while maintaining lower Word Error Rates (WER). The findings underscore the potential of autoencoders for efficient feature compression in resource-limited settings, enhancing the practicality of ASR systems for dysarthric speech.
Achieving an 8x reduction in training time without sacrificing ASR performance could revolutionize how we deploy speech recognition systems for dysarthric users.
Self-supervised learning (SSL) models extract rich speech representations but often come with high-dimensional features, increasing computational complexity. This work explores an SSL-AutoEncoder (SSL-AE) bottlenecking approach to efficiently reduce feature dimensions while maintaining dysarthric Automatic Speech Recognition (ASR) performance. By leveraging an autoencoder, we transform high-dimensional SSL features into a compact space, reducing model complexity and training time. Our method preserves essential speech information, achieving reduced Word Error Rates (WER) while significantly lowering computational costs. Experiments show SSL-AE bottlenecking reduces training time by 8x compared to the SSL baseline, demonstrating efficiency without sacrificing recognition performance. These results highlight AE as an effective solution for SSL feature compression in resource-constrained environments.
