Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of current spatial distortion metrics in evaluating binaural music source separation (MSS) by comparing them against human perceptual judgments. The findings indicate that existing metrics, particularly Interaural Time Difference (ITD) estimation, fail to reliably correlate with human perception, especially in the presence of noise and separation artifacts. Additionally, the research highlights a significant trade-off between robustness and accuracy in alternative ITD estimation methods, emphasizing the necessity for improved metrics tailored for binaural audio applications.
Current spatial metrics for binaural music source separation are unreliable, often failing to align with human perception, which could mislead future audio model developments.
Despite the rising popularity of immersive audio, binaural music remains underexplored in music information retrieval (MIR), particularly regarding the task of music source separation (MSS). While existing stereo MSS models can process binaural audio, they often degrade the spatial quality of the separated stems and undermine listener immersion. Through a perceptual study comparing binaural and stereo MSS outputs, we evaluate how well objective spatial distortion metrics correlate with human perception. Our findings reveal varied agreement between these metrics and human judgment, highlighting a lack of reliability when used to evaluate binaural music tasks. Specifically, we find that Interaural Time Difference (ITD) estimation is highly sensitive to noise and separation artifacts. In evaluating two alternative ITD estimation methods, we uncover a critical trade-off between robustness and accuracy, particularly for narrow-band instruments like bass. These results underscore the need for accurate, interpretable spatial metrics designed for binaural music to develop models that preserve source localization and listener immersion.