Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This paper introduces ZP-KWS, a novel framework for user-defined keyword spotting that effectively handles both unseen keywords and speakers by leveraging a phoneme-supervised audio encoder alongside a compact speaker encoder pre-trained with GE2E. The approach employs multiplicative late fusion during inference, allowing for flexible activation modes that can adapt to varying detection requirements without the need for retraining. Experimental results on multiple datasets demonstrate that ZP-KWS achieves a significant reduction in false rejection rates while maintaining competitive keyword detection performance, all within a lightweight parameter budget suitable for edge deployment.
ZP-KWS slashes false rejection rates by up to 60% while keeping keyword detection robust, all in a compact model designed for edge devices.
User-defined keyword spotting (UD-KWS) enables zero-shot wake-word detection from text, but existing systems learn speaker-invariant representations that cannot reject impostors uttering the correct keyword. We address this dual zero-shot setting -- unseen keywords and unseen speakers -- with ZP-KWS, a lightweight framework combining a phoneme-supervised audio encoder with a GE2E-pretrained compact speaker encoder (about 0.9M parameters). Multiplicative late fusion at inference grants each branch independent veto power, supporting modes from conventional detection to strict speaker-gated activation without retraining. On LibriPhrase, Google Speech Commands, and Qualcomm datasets, ZP-KWS reduces target-only FRR at 1% FAR by up to 60% relative to the strongest baseline while maintaining competitive keyword detection, all within a 1.55M parameter budget for edge deployment.