Search papers, labs, and topics across Lattice.
This paper introduces a fully differentiable neural architecture for phoneme alignment that leverages soft dynamic programming, addressing the stagnation in Forced Alignment methods compared to advancements in ASR systems. The model features a dual-branch encoder for phoneme identity verification and boundary detection, optimized with a novel contrastive loss to enhance alignment precision. Key results show that this approach surpasses existing state-of-the-art methods on hand-annotated English benchmarks and generalizes effectively to unseen languages, marking a significant leap in phoneme alignment technology.
Achieving superior phoneme alignment accuracy, this model outperforms traditional methods while generalizing across languages, challenging the status quo in speech recognition.
Recent advances in sequence modeling have significantly improved ASR systems, bringing them close to human-level recognition accuracy and enhancing robustness across diverse acoustic conditions and languages. In contrast, Forced Alignment has not experienced comparable progress, and traditional HMM-GMM frameworks remain widely adopted and highly competitive. To address this gap, we propose an end-to-end, fully differentiable neural architecture specifically designed for phoneme alignment. The model consists of an encoder that processes the input signal and a decoder that produces alignment decisions. The encoder is structured into two complementary branches: one dedicated to phoneme identity verification and the other to phoneme boundary detection. The decoder is implemented as a trainable module based on differentiable soft dynamic programming. The entire system is optimized end-to-end using a novel contrastive loss that encourages clear separation between steady-state phoneme regions and transition boundaries. The proposed approach outperforms the current state of the art in phoneme alignment on hand-annotated English benchmarks, achieves strong word-level generalization results, and demonstrates generalization on unseen languages.
