Search papers, labs, and topics across Lattice.
This paper introduces kiloVAD, a highly efficient voice activity detection model tailored for edge deployment, which utilizes standard Mel features and CNN-only architectures to meet stringent memory and latency requirements. By implementing per-layer structured pruning combined with self-distillation and angle-based quantization-aware training, kiloVAD surpasses traditional quantization methods, achieving a 1-4% improvement in performance. Evaluated under causal conditions, kiloVAD sets a new benchmark with an AUC of 0.850 on the AVA-Speech dataset, while maintaining a compact size of just 2.1k parameters and a 200 ms context window.
kiloVAD achieves state-of-the-art performance for voice activity detection with only 2.1k parameters, revolutionizing edge deployment capabilities.
Voice activity detection (VAD) triggers downstream speech processing in always-on systems under strict memory, latency, and compute constraints. Recent compact models report strong accuracy but rely on components that are not widely supported: learnable filterbanks, recurrent layers, or non-causal post-processing. We propose kiloVAD, designed for embedded inference using standard Mel features, CNN-only layers, and tunable context/spectral parameters. We introduce per-layer structured pruning with self-distillation and angle-based quantization-aware training (QAT) that outperforms standard QAT by 1-4%. Evaluated per-frame under causal conditions, kiloVAD achieves 0.850 AUC on AVA-Speech with 2.1 k parameters and 200 ms context, establishing a new state of the art for causal, deployment-ready VAD.