Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates cross-cultural bias in mel-scale audio representations, a ubiquitous feature in modern audio systems, by comparing its performance against learnable and psychoacoustic alternatives across speech, music, and acoustic scene classification tasks. The study reveals that mel-scale features exhibit significant performance disparities between tonal and non-tonal languages (12.5% WER gap) and Western and non-Western music (15.7% F1 degradation). Alternative representations like LEAF, CQT, and ERB-scale filtering substantially reduce these biases, demonstrating the potential for more equitable audio processing.
Mel-scale audio features, a cornerstone of modern audio systems, encode significant cultural biases that lead to substantial performance gaps across languages and musical traditions.
Modern audio systems universally employ mel-scale representations derived from 1940s Western psychoacoustic studies, potentially encoding cultural biases that create systematic performance disparities. We present a comprehensive evaluation of cross-cultural bias in audio front-ends, comparing mel-scale features with learnable alternatives (LEAF, SincNet) and psychoacoustic variants (ERB, Bark, CQT) across speech recognition (11 languages), music analysis (6 collections), and European acoustic scene classification (10 European cities). Our controlled experiments isolate front-end contributions while holding architecture and training protocols minimal and constant. Results demonstrate that mel-scale features yield 31.2% WER for tonal languages compared to 18.7% for non-tonal languages (12.5% gap), and show 15.7% F1 degradation between Western and non-Western music. Alternative representations significantly reduce these disparities: LEAF reduces the speech gap by 34% through adaptive frequency allocation, CQT achieves 52% reduction in music performance gaps, and ERB-scale filtering cuts disparities by 31% with only 1% computational overhead. We also release FairAudioBench, enabling cross-cultural evaluation, and demonstrate that adaptive frequency decomposition offers practical paths toward equitable audio processing. These findings reveal how foundational signal processing choices propagate bias, providing crucial guidance for developing inclusive audio systems.