Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the use of Feature-wise Linear Modulation (FiLM) for speaker conditioning in automatic speech recognition (ASR) systems, specifically targeting the challenges posed by pathological speech. By injecting x-vector-derived information into the transformer layers of a frozen ASR encoder, the authors successfully adapt the model to individual pathological speakers without altering the base model weights. The results indicate that this approach is competitive with traditional fine-tuning methods while maintaining performance on standard speech tasks, highlighting its potential for practical applications in ASR for diverse speech conditions.
Speaker conditioning via FiLM can enhance ASR performance for pathological speech without compromising standard speech recognition capabilities.
Automatic speech recognition (ASR) has advanced remarkably for standard speech; however, pathological speech from neurological conditions remains a significant challenge. We investigate speaker conditioning via Feature-wise Linear Modulation (FiLM), injecting x-vector-derived information into each transformer layer of a frozen ASR encoder to adapt internal representations to individual pathological speakers without modifying base model weights. We benchmark this for the ASR task against standard and parameter-efficient fine-tuning baselines, complemented by post-processing, on Spanish and English pathological speech. Additionally, we evaluate if the adapted model preserves the ability to answer speech-related questions. Results show that speaker-conditioned ASR is competitive with established adaptation strategies while retaining performance on non-conditioned speech.