Search papers, labs, and topics across Lattice.
This paper details an innovative approach to text-to-music generation that incorporates a learned human-preference reward from TuneJury, enhancing the model's ability to align generated music with human preferences. The authors conducted a comprehensive evaluation of their method using a 120M-parameter FluxAudio-S backbone, revealing that expert iteration significantly improves output quality, while preference-tuning offers minimal gains. Ultimately, the findings highlight the importance of integrating human feedback into generative models to achieve superior performance in music generation tasks.
Expert iteration emerges as the key driver of quality in text-to-music generation, overshadowing the contributions of preference tuning.
We describe our entry to the efficiency track of the Academic Text-to-Music (ATTM) Grand Challenge at ICME 2026. Beyond the challenge protocol's FAD-CLAP and CLAP score, we add a learned human-preference reward from TuneJury, a twin pairwise ranker trained over open music-preference datasets. The reward serves both as a training-time conditioning signal and as a sample-selection criterion. The pipeline combines five engineering decisions on a 120M-parameter FluxAudio-S backbone, four at training time and one at inference: (i) training-time reward conditioning that doubles as an inference-time CFG axis, (ii) a sweep over five score-conditioning architectures, where training and inference use different variants, (iii) expert iteration on the top decile, (iv) a short preference-tuning pass (CRPO) for audio-text alignment, and (v) inference post-processing via joint CFG, source separation, and loudness normalization. Per-stage decomposition on 100 Song Describer prompts shows training-time reward conditioning as a functional conditioning axis, expert iteration as the dominant contributor, the preference-tuning pass adding only noise-level gain, and the inference-time score scalar already saturated by the end of the chain.
CMU ML