Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ArtNet, a novel framework that enhances zero-shot cross-lingual phoneme recognition by leveraging articulatory features to mitigate the challenges posed by language-specific variations. By integrating an articulatory predictor with a variational information bottleneck, ArtNet effectively extracts universal articulatory representations from self-supervised learning features. The framework demonstrates substantial improvements in phoneme recognition accuracy across seven unseen languages, achieving a 20.56% relative reduction in phoneme error rate and a 7.01% reduction in phoneme feature error rate when combined with the vector-space inventory alignment strategy.
Achieving a 20.56% reduction in phoneme error rates, ArtNet redefines how we approach zero-shot phoneme recognition across languages.
Zero-shot cross-lingual phoneme recognition is often hindered by the fragility of direct acoustic-to-symbol mapping, which is susceptible to language-specific variations. Echoing joint-embedding predictive architecture (JEPA) work in vision, we propose ArtNet, a framework that explores a structured feature prediction task based on articulatory features to enhance acoustic robustness. Specifically, ArtNet integrates an articulatory predictor, designed to extract universal articulatory representations from self-supervised learning (SSL) features, with a variational information bottleneck (VIB) to suppress language-specific variations. Experiments on seven unseen languages demonstrate that ArtNet, particularly when synergized with the proposed vector-space inventory alignment (VSIA) strategy, significantly outperforms competitive baselines, achieving a 20.56\% relative reduction in phoneme error rate (PER) and 7.01\% in phoneme feature error rate (PFER).