Search papers, labs, and topics across Lattice.
SymphonyGen, a 3D hierarchical framework, was developed to address the complexity-control imbalance in symphonic music generation by decomposing the generation process across Bar, Track, and Event axes. This architecture uses a beat-quantized multi-voice harmony skeleton for conditioning, allowing for high-level control while maintaining textural diversity. Refinement via Group Relative Policy Optimization (GRPO) with a cross-modal audio-perceptual reward and a dissonance-averse sampling algorithm further enhances harmonic cleanliness and melodic expression.
SymphonyGen's 3D hierarchical approach to music generation lets you steer the overall structure of a symphony without sacrificing the richness and detail of the orchestration.
Generating symphonic music requires simultaneously managing high-level structural form and dense, multi-track orchestration. Existing symbolic models often struggle with a"complexity-control imbalance", in which scaling bottlenecks limit long-term granular steerability. We present SymphonyGen, a 3D hierarchical framework for contemporary cinematic orchestration. SymphonyGen employs a cascading decoder architecture that decomposes the Bar, Track, and Event axes, improving computational efficiency and scalability over conventional 1D or 2D models. We introduce"short-score"conditioning via a beat-quantized multi-voice harmony skeleton, enabling outline control while preserving textural diversity. The model is further refined using Group Relative Policy Optimization (GRPO) with a cross-modal audio-perceptual reward, aligning symbolic output with modern acoustic expectations. Additionally, we implement a dissonance-averse sampling algorithm to suppress unintended tonal clashes during inference. Objective evaluations show that both reinforcement learning and dissonance-averse sampling effectively enhance harmonic cleanliness while maintaining melodic expression. Subjective evaluations demonstrate that SymphonyGen outperforms baselines in musicality and preference for orchestral music generation. Demo page: https://symphonygen.github.io/
