Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces two algorithms for robust speaker localization in reverberant environments using microphone arrays. The first algorithm uses spectrotemporal decomposition with a novel speech onset detection method based on signal and impulse response models, combined with multichannel cross-correlation. The second algorithm enhances the generalized cross-correlation phase transform method by leveraging redundant microphone information to mitigate reverberation effects. Experiments on both simulated and real-world reverberant recordings demonstrate the proposed methods' superior performance in localizing static and moving speakers compared to state-of-the-art approaches.
Speaker localization in noisy, real-world environments just got a whole lot better thanks to a new method that cleverly exploits speech onsets to suppress reverberation.
Many speaker localization methods can be found in the literature. However, speaker localization under strong reverberation still remains a major challenge in the real-world applications. This paper proposes two algorithms for localizing speakers using microphone array recordings of reverberated sounds. To separate concurrent speakers, the first algorithm decomposes microphone signals spectrotemporally into subbands via an auditory filterbank. To suppress reverberation, we propose a novel speech onset detection approach derived from the speech signal and impulse response models, and further propose to formulate the multichannel cross-correlation coefficient of encoded speech onsets in each subband. The subband results are combined to estimate the directions-of-arrival of speakers. The second algorithm extends the generalized cross-correlation phase transform method by using redundant information of multiple microphones to address the reverberation problem. The proposed methods have been evaluated under adverse conditions using not only simulated signals (reverberation time <inline-formula><tex-math notation="LaTeX">$T_{60}$</tex-math> </inline-formula> of up to <inline-formula><tex-math notation="LaTeX">$1$</tex-math></inline-formula>s) but also recordings in a real reverberant room (<inline-formula><tex-math notation="LaTeX">$T_{60} \approx 0.65$</tex-math> </inline-formula>s). Comparing with some state-of-the-art localization methods, experimental results confirm that the proposed methods can reliably locate static and moving speakers, in presence of reverberation.