Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the impact of room-acoustic simulation fidelity on the performance of multichannel speech enhancement models, specifically focusing on the SpatialNet architecture. By comparing datasets augmented with simplified geometrical acoustics to those enhanced with high-fidelity wave-based simulations, the authors demonstrate that the latter can significantly improve model performance. The findings reveal that training on high-fidelity datasets leads to up to a 38% relative reduction in median word error rate, highlighting the importance of accurate simulations in enhancing speech recognition capabilities.
Training with high-fidelity room-acoustic simulations can slash word error rates by up to 38% in multichannel speech enhancement tasks.
Room-acoustic simulations are widely used to augment training data for deep-learning-based speech enhancement. While most pipelines rely on simplified geometrical acoustics, wave-based approaches offer greater physical accuracy. In this work, we examine how simulation fidelity affects multichannel speech enhancement performance. To this end, we train SpatialNet on datasets augmented with different room-acoustic simulation methods and evaluate the resulting models on measured data. We compare lower-fidelity datasets based on geometrical acoustics with a high-fidelity dataset using advanced acoustic modelling and a hybrid combination of wave-based and geometrical acoustics simulations. Training on the high-fidelity dataset results in an up to 38 % relative reduction in median word error rate compared to the lower-fidelity alternatives. These results show that augmentation with high-fidelity room-acoustic simulations directly translates into improved multichannel speech enhancement performance.