Search papers, labs, and topics across Lattice.
MulTTiPop is a newly curated dataset designed for evaluating automatic music transcription models, comprising 572 segments of pop music with multitrack MIDI recordings spanning from the 1930s to the 2000s. The dataset was created through a meticulous process of metadata matching, manual beat anchoring, and MIDI warping to ensure precise alignment with audio. Evaluation of current transcription models on MulTTiPop revealed a significant performance gap, with the leading model achieving only 38% Onset F1, indicating substantial opportunities for advancement in this area.
Automatic music transcription models struggle with pop music, as evidenced by a mere 38% Onset F1 score on the new MulTTiPop dataset.
We present MulTTiPop, a dataset of pop music segments and their associated multitrack MIDI recordings for the evaluation of automatic music transcription models. MulTTiPop contains 572 segments of popular music totaling 3.5 hours of audio, and contains songs from diverse genres and decades from the 1930s to 2000s. To collect this dataset, we perform metadata-based matching on song segments from the Lakh MIDI and TheoryTab datasets, manually identify an anchor beat between the audio and MIDI, then use beat tracking on the audio and warp the MIDI to match its tempo and timing. We evaluate state-of-the-art automatic music transcription models on MulTTiPop and find substantial room for improvement, with the best model achieving 38% Onset F1. More details and sound examples of MulTTiPop are available at https://gclef-cmu.org/multtipop.
CMU ML