Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
This paper introduces MERIT, a framework designed to learn disentangled music representations that focus on distinct musical dimensions such as melody, rhythm, and timbre. By employing a novel training strategy that utilizes conditional audio generation and source-separated stems, the authors achieve strong factor-wise disentanglement, allowing for nuanced user queries and improved interpretability. Evaluations show that each representation head effectively responds to its target dimension while maintaining low sensitivity to others, demonstrating the framework's robustness across both synthetic and real-world audio datasets.
MERIT achieves unprecedented disentanglement in music representations, enabling precise control over melody, rhythm, and timbre in audio similarity tasks.
Current music similarity models typically compute a single, monolithic score, entangling distinct musical dimensions like melody, rhythm, and timbre. This limits user control and interpretability, making it impossible to execute nuanced queries. We introduce MERIT, a framework for learning disentangled, factor-specific music representations tailored to these three core dimensions. To overcome the lack of isolated musical variations in real-world audio, we use a novel training strategy that uses conditional audio generation and source-separated stems to strongly encourage single-factor variation in training data. Our evaluations demonstrate strong factor-wise disentanglement. Each head responds strongly to its intended perceptual dimension while remaining near chance on the others, a representational property that holds across both the synthetic training domain and independent real-world audio.