Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces KFC-KWS, a multimodal framework designed for user-defined keyword spotting that effectively distinguishes target keywords from phonetically similar alternatives. By utilizing connectionist temporal classification (CTC) to guide keyframe selection, the method identifies high-confidence phoneme frames, which are then fused with full-utterance representations using cross-attention to enhance both local and global context. The approach achieves state-of-the-art performance on the LibriPhrase dataset, with an AUC of 98.73% and significant improvements on challenging subsets, underscoring its robustness in keyword discrimination.
Achieving 98.73% AUC, KFC-KWS redefines user-defined keyword spotting by expertly fusing keyframe and utterance representations to tackle phonetic confusion.
User-defined keyword spotting (KWS) enables personalized voice interaction by detecting user-specified keywords. A key challenge in this task is distinguishing target keywords from phonetically confusable alternatives. To address this challenge, we propose KFC-KWS, a multimodal framework that leverages connectionist temporal classification (CTC)-guided keyframe selection. Specifically, we exploit the peaky posterior distributions of CTC to identify high-confidence phoneme frames, enabling precise alignment across audio, phoneme, and text modalities. These keyframes are then fused with full-utterance representations through cross-attention to capture both local discriminative cues and global contextual information. On LibriPhrase, KFC-KWS achieves the best-balanced performance (98.73% AUC) and substantially outperforms advanced baselines on the challenging hard subset (97.65% AUC and 7.75% EER), demonstrating its effectiveness in discriminating between highly confusable keywords.