Search papers, labs, and topics across Lattice.
This study introduces Dense-Sparse Dynamic Time Warping (DTW) to enhance the customization of Music Minus One (MMO) piano concerto accompaniments by aligning solo piano performances with orchestral recordings. By leveraging a mixed recording as a reference, the method addresses the challenge of spectral mismatches between different audio sources, allowing for effective time-scale modifications of orchestral parts. The results demonstrate that Dense-Sparse DTW outperforms or matches the performance of more complex techniques, providing a robust solution for generating tailored musical accompaniments.
Dense-Sparse DTW can significantly improve the customization of piano accompaniments, outperforming complex methods while simplifying the alignment process.
In this study, we explore how pianists can customize Music Minus One (MMO) concerto accompaniments to match their playing style. Bypassing the need for a symbolic score, often not available digitally, we use three types of audio data: solo piano recordings, MMO orchestra-only recordings, and mixed recordings of both piano and orchestra (e.g., from YouTube). The mixed recording serves as an intermediary reference to align the solo and orchestra parts, with only the orchestral part being adjusted through time-scale modification to synchronize with the user鈥檚 playing. The main challenge with estimating these alignments is the spectral mismatch between recordings containing different musical parts. Motivated by this application scenario, we introduce Dense-Sparse DTW, a variant of Dynamic Time Warping (DTW) that is designed to improve robustness of alignments to spectral mismatch by focusing on aligning a selected subset of audio frames containing prominent timing cues. We collect and annotate data from four piano concerto movements and establish a framework for generating and evaluating customized accompaniment recordings. On this benchmark, we show that Dense-Sparse DTW has better or comparable performance than more complex approaches based on source separation and spectral subtraction techniques.
