Search papers, labs, and topics across Lattice.
This paper introduces Next-Turn, a novel approach to endpoint detection (EPD) in streaming speech systems that leverages time-to-next-speech-onset prediction as its training objective. By deriving targets directly from speech timestamps without requiring additional annotations, the method addresses the challenges posed by speaker hesitations and disfluencies. Experimental results demonstrate a significant 25.9% absolute improvement in endpoint accuracy within 320 ms compared to conventional acoustic and recent semantic EPD baselines, particularly benefiting from joint training with a duration-aware objective.
Achieving a 25.9% boost in endpoint accuracy, Next-Turn redefines how we handle speech disfluencies in real-time systems.
Endpoint detection (EPD) is essential for natural turn-taking in streaming speech systems. However, reliably determining the endpoint of an utterance is challenging because speakers often pause mid-utterance due to hesitations and disfluencies. Semantic EPD has emerged as a promising direction to address this issue but is hindered by ambiguous supervision and strict streaming constraints. We propose Next-Turn that uses the time-to-next-speech-onset as the training objective, where targets are derived directly from speech timestamps and require no additional annotation. Experiments show that the proposed method outperforms conventional acoustic and recent semantic EPD baselines, achieving a 25.9% absolute improvement in endpoint accuracy within 320 ms over the strongest baseline. In addition, joint training with the duration-aware objective complements standard binary EPD, with gains that increase monotonically with increasing pauses.
