Search papers, labs, and topics across Lattice.
This paper introduces MultiVerse, a creator-centered system designed to enhance the adaptive composition of song lyrics by allowing artists to specify controls based on their intent and audience context. By conducting a study with 10 songwriters, the authors found that creators preferred this explicit authoring approach over traditional prompting methods, despite acknowledging trade-offs in flexibility and iteration speed. The findings suggest that adaptive media can foster deeper audience connections and reshape the creative process, challenging conventional notions of authorship in music composition.
Creators prefer steering adaptive lyrics through explicit controls, reshaping their creative process and audience engagement.
Generative AI may enable new forms of context-aware creative expression by dynamically tailoring media content to its consumption context. For instance, AI systems could adapt song lyrics to the listener and their current activity. However, existing media adaptation systems primarily optimize for audience experience, often neglecting artists'intent, style, and preference. We address this challenge by introducing a novel creator-centered approach to adaptive media authoring and present MultiVerse, a system that instantiates this approach for steering adaptive lyrics. Our approach allows creators to explicitly author controls based on their intent, lyric structure, and audience context, and uses rule-based validations to ensure controls are followed. We conducted a study with 10 songwriters, comparing MultiVerse with a prompting-based workflow for composing adaptive lyrics. The comparison revealed that creators preferred to author how lyrics adapt by explicitly specifying relevant context and adaptation constraints, while recognizing trade-offs in flexibility and iteration speed. Interviews further revealed that creators viewed adaptive media as enabling new forms of audience connection, introducing a distinct creative process, favoring new compositional strategies, and reshaping notions of authorship.
