Search papers, labs, and topics across Lattice.
This paper introduces Libretto, a framework designed to enhance symbolic music generation and revision by leveraging an LLM-native grammar that incorporates explicit musical structures such as onset slots and bar-level organization. By evaluating generated pieces against a corpus-calibrated statistical space focusing on various musical elements like rhythm and harmony, Libretto enables effective retrieval, diagnosis, and iterative self-revision of music. The framework demonstrates its versatility through applications in gap filling, reference-guided generation, gradual morphing, and educational contexts, transforming music into a measurable and editable format for language-model agents.
Libretto transforms symbolic music generation into a structured, editable process, enabling LLMs to create and revise music with unprecedented precision and control.
Generative music systems can now produce impressive audio from text prompts, but audio outputs are difficult to inspect, edit, and diagnose as musical structure. We introduce Libretto, an agent-facing framework for symbolic music generation and revision. Libretto uses an LLM-native grammar with explicit onset slots, voices, and bar-level organization, then evaluates each piece in a corpus-calibrated statistical space over rhythm, harmony, melody, texture, form, and variation. The same structural axes support retrieval, diagnosis, copy-risk control, and iterative self-revision. Across gap filling, reference-guided full-piece generation, gradual morphing, and educational music generation, Libretto turns symbolic music from a raw token sequence into a measurable and editable object for language-model agents.
BAIR