Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the wav2vec2.0 architecture's ability to exhibit perceptual compensation for phonological context, specifically focusing on Mandarin Chinese tones. Through a pseudo-replication of a previous experiment, the researchers found that while the fine-tuned model showed some evidence of compensation, the purely self-supervised pre-trained model did not demonstrate any compensation in embedding similarities. These results challenge earlier claims of inherent phonological sensitivity in self-supervised models, indicating that supervised training may be essential for capturing certain phonological regularities.
Self-supervised speech models may lack the phonological sensitivity needed for effective tonal context processing, revealing a critical gap in current training methodologies.
This study examines the extent to which the wav2vec2.0 architecture exhibits evidence of compensation for phonological context. We conducted a pseudo-replication of a perceptional compensation experiment on Mandarin Chinese tones, and compared the embedding similarities and probing classifier outputs between a purely self-supervised pre-trained model and a model fine-tuned for Mandarin ASR. No evidence of compensation was found in the embedding similarities of the purely pre-trained model. Probing classifiers showed some evidence of compensation in addition to the expected layer-wise improvements in categorization, but failed to replicate human performance on isolated test syllables. Our findings contrast with previous reports of sensitivity to phonological structure emerging through pre-training alone, and suggest that supervised objectives may be necessary to encourage the abstraction of at least some types of phonological regularities.