Search papers, labs, and topics across Lattice.
This paper introduces Decomposer, a framework designed to recover executable music programs from symbolic MIDI data, addressing the challenges posed by the low-resource nature of the Strudel programming language and the risk of producing unreadable code. By first creating a synthetic corpus of paired Strudel programs and MIDI for supervised fine-tuning, and then employing reinforcement learning to optimize for both reconstruction fidelity and code readability, the authors enhance the decompilation process. The results demonstrate that Decomposer significantly outperforms existing closed-source models in MIDI reconstruction fidelity while generating more readable and diverse code outputs.
Decomposer achieves superior MIDI reconstruction fidelity and code readability compared to existing models, transforming how we approach symbolic music decompilation.
Musical performance involves executing a set of high-level musical instructions, yet recovering those instructions from the performance is a challenging inverse problem. We present Decomposer, a post-training framework for symbolic music decompilation: the task of recovering executable, editable music programs from symbolic music. We instantiate the task as MIDI-to-Strudel decompilation, where the model takes symbolic MIDI as input and produces a program in Strudel, a music programming language, that reconstructs the input when executed. The task poses two challenges: Strudel is a low-resource language with little naturally paired MIDI-code data, and optimizing faithful reconstruction of MIDI alone can collapse to unreadable note-by-note transliteration. We address these challenges in two stages. First, we construct Strudel-Synth, a synthetic corpus of paired Strudel programs and rendered MIDI, and use it for supervised fine-tuning. Second, we refine the model with reinforcement learning on unpaired MIDI, optimizing rewards for both MIDI reconstruction faithfulness and code readability. Our evaluation across synthetic and real-world MIDI benchmarks shows that Decomposer achieves substantially higher MIDI reconstruction faithfulness than closed-source LLMs while producing more readable and diverse code than the heuristic converter.
CMU ML