Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the alignment of music large language models (MusicLLMs) with emotional metrics through two strategies: instruction tuning and feedback-driven alignment. While instruction tuning provides some improvement in predicting arousal and valence scores, the introduction of feedback-driven alignment significantly enhances performance, achieving better accuracy in emotion regression tasks. Notably, this method preserves the models' capabilities in music question answering, indicating a dual benefit of improved emotional alignment without sacrificing other functionalities.
Feedback-driven alignment boosts MusicLLM's emotion prediction accuracy, outperforming traditional instruction tuning methods.
This paper investigates whether music large language models (MusicLLMs) can be aligned for emotion regression. While MusicLLMs have shown strong performance in music information retrieval tasks, their ability to predict arousal and valence scores remains limited, since emotion regression has not been an explicit training objective. To examine whether MusicLLMs can be aligned with emotion, we train MusicLLMs on emotion regression and compare two strategies: instruction tuning and feedback-driven alignment. Our experiments show that task-aware instruction tuning enables MusicLLMs to predict emotion levels to some extent, although the accuracy remains limited. Applying feedback-driven alignment with a verifiable numerical reward substantially improves performance on both arousal and valence over instruction tuning alone. We further show that our approach improves emotion regression performance while maintaining MusicQA capability.