Search papers, labs, and topics across Lattice.
ViP-VL is a novel Vietnamese self-supervised speech pretraining model that utilizes Vector-quantization Learning to enhance processing efficiency while maintaining high audio resolution. By integrating Acoustic Stacking and Receptive Field Alignment within the ChunkFormer architecture, the model achieves an 8x subsampling rate and improves representation robustness through a targeted Mask Selection Strategy during pretraining on a substantial dataset of 17,000 hours of unlabeled Vietnamese speech. This approach leads to state-of-the-art performance across four key tasks: Automatic Speech Recognition, Speech Emotion Recognition, Dialect Classification, and Speaker Verification.
Achieving state-of-the-art results in Vietnamese speech tasks, ViP-VL redefines efficiency in self-supervised speech models with groundbreaking subsampling techniques.
We present ViP-VL, an efficient Vietnamese Self-supervised speech Pretraining model leveraging Vector-quantization Learning. To bridge the gap between high-resolution audio and efficient processing, ViP-VL incorporates Acoustic Stacking and Receptive Field Alignment to enable a synchronized 8x subsampling rate within the ChunkFormer architecture, while further enhancing representation robustness through a specialized Mask Selection Strategy during pretraining on the BEST-RQ framework. Pretrained on 17,000 hours of unlabeled Vietnamese speech, our model establishes new state-of-the-art results across four major downstream tasks: Automatic Speech Recognition, Speech Emotion Recognition, Dialect Classification, and Speaker Verification. To facilitate future research and the development of high-performance Vietnamese speech technologies, we publicly release our pretrained weights and implementation at github.com/khanld/chunkformer.
