Search papers, labs, and topics across Lattice.
This study introduces the SheetSage-A2S Dataset, comprising 61 hours of audio and score encodings for popular music, addressing a significant gap in audio-to-score (A2S) research. By leveraging data augmentation techniques and the MuQ pretrained feature-extraction model, the authors enhance the generalization abilities of A2S systems, achieving a symbol error rate (SER) of 4.98% for classical music and 20.92% for popular music. These results not only surpass the previous state-of-the-art but also establish a new benchmark for future A2S research in popular music.
A new dataset and model achieve a staggering 4.98% symbol error rate for classical music, setting a high bar for audio-to-score transcription in popular music.
Existing audio-to-score (A2S) systems primarily focus on classical music, and the application to popular music remains underexplored. This paper first presents the new SheetSage-A2S Dataset, which includes 61 hours of audio with \texttt{**kern} score encodings for 9,468 clips originating from 6,066 unique songs, the first of its kind to facilitate A2S research for popular music. Additionally, we improve on existing A2S approaches by using data augmentation and MuQ, a pretrained feature-extraction model for music audio, to enhance generalisation abilities and extract meaningful audio features. Results show that the proposed A2S model achieves 4.98\% symbol error rate (SER) on the Quartets collection for classical music, which significantly outperforms the 15.3\% SER from the existing state-of-the-art \cite{alfaro-contrerasTransformer2024}. Additionally, our model achieves 20.92\% SER on the SheetSage-A2S dataset for popular music, serving as a strong benchmark for future research. The dataset, model, and code are made publicly available at: https://github.com/Multimodal-Music-Research-Lab/SheetSage2Kern_model.
