Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
MilaAix Marseille UnivConcordia UniversityGIPSA-labGrenoble INPINRIALavalUniv ToulonUniv. Grenoble AlpesSep 29, 2026arXiv:2609.37798GLaS-JEPA eliminates the complex machinery of modern speech self-supervised learning—such as vector quantization, contrastive pairs, and EMA teacher networks—by training an encoder to directly predict its own continuous representations at masked positions. To prevent representation collapse in the absence of asymmetric target generators, the approach applies SIGReg, an explicit Gaussian representation-space regularizer. When pretrained on 960 hours of LibriSpeech, the resulting 57M-parameter model achieves a 6.89% WER on frozen SUPERB ASR, outperforming the strongest non-distilled sub-90M baselines by 43.1%.
Speech SSL works better without the baggage of discrete codebooks or EMA teachers: predicting raw latent states under Gaussian regularization outpaces existing sub-90M baselines by 43% on frozen ASR.
Speech self-supervised learning aims to learn general-purpose representations for downstream speech tasks. However, current approaches rely on complex, carefully designed prediction targets. We challenge this necessity with GLaS-JEPA, a framework that directly predicts the current encoder's continuous representations at masked positions, without contrastive learning, discrete targets, or separate EMA target encoders. We prevent representation collapse using SIGReg representation-space regularization, eliminating the need for engineered target-generation mechanisms. Pretrained on 960 hours of LibriSpeech, our 57M-parameter model achieves a 6.89% WER on frozen-encoder SUPERB ASR and a 25.87% CER on slot filling, outperforming the best non-distilled sub-90M baselines by 43.1% and 22.0%, respectively. These results demonstrate that highly competitive speech representations can emerge from a radically simplified training recipe.