Search papers, labs, and topics across Lattice.
This paper introduces an attribute-guided genre expansion framework to enhance the diversity of creative writing data for large language models (LLMs), moving beyond the limitations of story-centric datasets. By utilizing human-authored prompts and curated genre attributes, the authors create the Multi-Genre Collection, a 50,000-example corpus that spans 13 distinct creative genres. Experiments show that models fine-tuned on this corpus outperform both baseline models and those trained on traditional writing datasets, highlighting the importance of genre-specific training for improving creative writing capabilities.
Controlled genre expansion, rather than just story-centric data, is crucial for unlocking robust creative writing skills in LLMs.
High-quality creative writing data for large language models (LLMs) remains dominated by story-centric data, limiting models'ability to follow the structural and functional conventions of diverse creative formats. We propose an attribute-guided genre expansion framework for scaling creative writing data beyond story generation. By separating thematic breadth from genre-form control, our framework leverages human-authored story prompts as diverse creative seeds, while utilizing manually curated genre attributes to enforce distinct structural, stylistic, and formatting conventions. We combine these to prompt strong LLMs for genre-faithful query-response pairs, which are then quality-filtered. Applying this framework, we construct the Multi-Genre Collection, a 50K-example corpus spanning 13 creative genres, including story, rap, lyrics, scripts, game design, character design, and other creative formats. Experiments across out-of-distribution writing benchmarks and held-out genre diagnostics demonstrate that models fine-tuned on our data consistently surpass not only base models and writing-specialized baselines, but also models trained on existing writing corpora. Genre-count ablations further indicate that controlled genre expansion, rather than story-centric scaling alone, is a key driver of robust creative writing capability.
