Search papers, labs, and topics across Lattice.
This paper introduces a low-latency streaming pipeline for real-time target speaker identification, crucial for applications like hearing aids where latency can be perceptible. The approach employs a two-step method involving low-latency streaming diarization followed by speaker verification, utilizing the This American Life Podcast Transcripts dataset to simulate conversational speech. The system achieves over 0.90 median accuracy with high specificity, validating its potential for practical use in selective amplification scenarios.
Achieving over 90% accuracy in real-time target speaker identification could revolutionize hearing aid technology by enabling selective amplification with minimal latency.
We present a real-time pipeline of open source, pretrained models for streaming identification of a target speaker, motivated by hearing-aid applications where latency as low as 10 ms can be perceptible. We formulate a two-step approach in which incoming audio is first segmented by speaker using low-latency streaming diarization, followed by speaker verification against a registered target speaker. To emulate conversational speech while minimizing overlap, we use the This American Life Podcast Transcripts dataset and select the host as a consistent target speaker. We benchmark offline diarization with Pyannote and LIUM using diarization error rate (DER) and select Pyannote based on baseline performance and compatibility with streaming. We then evaluate speaker verification using Pyannote and TitaNet-Large and generate ROC curves to select an operating region. We integrate Diart and tune clustering parameters to reduce DER while maintaining real-time operation. We pair Diart with Pyannote verification and evaluate system-level performance by converting predicted and ground-truth speech regions into 100 ms binary masks. Across 17 evaluation episodes, the system achieves greater than 0.90 median accuracy with high specificity (0.95-0.98) at cosine distance thresholds of 0.7-0.75, demonstrating a practical proof of concept for downstream low-latency selective amplification.
