Search papers, labs, and topics across Lattice.
This paper introduces a lightweight model for own-voice cancellation (OVC) that effectively removes a target speaker's voice from a noisy multi-speaker environment while maintaining the integrity of other speech. The model addresses the critical issue of latency-induced artifacts in far-field devices, which can distort the user's own voice during playback. By employing a time-domain approach with minimal latency and optimizing the architecture, the authors demonstrate significant improvements in signal-to-distortion ratio and mean opinion score (MOS), establishing OVC as a viable solution for real-time audio enhancement.
Own-voice cancellation can now be achieved with just 2 ms of latency, transforming how we handle speech enhancement in noisy environments.
We introduce own-voice cancellation (OVC): removing a target (enrolled) speaker from a noisy multi-speaker mixture while preserving any remaining speech. Framed as the complement of target speaker extraction, OVC addresses latency-induced own-voice artifacts that arise when a far-field device streams enhanced audio back to the user, as the round-trip time easily exceeds the perceptual threshold for own-voice distortion. We condition a time-domain model with only 2 ms algorithmic latency on a short enrollment utterance and benchmark TD-SpeakerBeam alongside a lighter Mamba-MinGRU masker built from Mamba blocks with MinGRU temporal mixing. Replacing the ConvTasNet-based auxiliary network with a linear RNN encoder improves both signal-to-distortion ratio and predicted MOS while reducing compute. Results establish OVC as a practical, low-latency enhancement objective for far-field denoising.