Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to Automatic Drum Transcription (ADT) by employing a separate-and-detect framework that first generates editable drum stems using a latent diffusion model before converting them into symbolic drum events. The method outperforms a strong U-Net baseline in transcription F1 scores and provides the added benefit of separated audio stems, enhancing usability for editing and remixing. Notably, the study reveals that the auxiliary onset branch significantly stabilizes transcription performance, indicating the potential of generative drum demixing for interpretable transcription tasks.
Generative drum demixing not only enhances transcription accuracy but also produces editable audio stems, revolutionizing how we approach drum source separation.
Automatic Drum Transcription (ADT) is commonly formulated as a direct mapping from a music mixture to symbolic drum events. While effective for transcription, this formulation discards the acoustic stems that are useful for editing, remixing, and production. We revisit an alternative separate-and-detect formulation, where a drum source separation front end first produces five editable drum stems, and a fixed onset detector then converts each stem into symbolic events. The separator is built on a five-stem latent diffusion model that jointly generates kick, snare, toms, hi-hats, and cymbals in a compact VAE latent space. We further study two training-only auxiliary branches--an onset branch (OB) and a timbre branch (TB)--which shape the separator during learning but are discarded at inference. Trained on synthetic drum multitracks and evaluated on MDB Drums and ENST-Drums, the proposed pipeline consistently improves over a strong U-Net-based drum separation baseline in overall transcription F1. It also outperforms a representative end-to-end ADT system on kick and snare F1 under our evaluation protocol, while additionally providing separated audio stems. The ablation results show that OB gives the most stable transcription gains, whereas TB changes the trade-off between reconstruction, acoustic stem quality, and onset detection. These results suggest that generative drum demixing can serve not only as a source separation model, but also as a practical front end for interpretable drum transcription.
