Search papers, labs, and topics across Lattice.
This paper introduces a framework for interpreting style representations in writing by utilizing style-eliciting prompts that guide large language models (LLMs) to generate text reflecting specific stylistic attributes. By curating a dataset of 1,010 distinct style features across 26 categories, the authors train a decoder to generate prompts from style representations, enabling effective recovery and imitation of writing styles. The results show that this approach outperforms traditional methods, providing a more interpretable and practical interface for accessing stylistic information encoded in representations.
Style-eliciting prompts can unlock the latent stylistic information in writing representations, outperforming traditional LLM prompting methods in both style recovery and imitation.
Style representation learning is a powerful tool for authorship analysis and modeling writing style, yet the latent nature of learned representations makes them difficult to interpret. Recent work has attempted to explain these representations by generating natural language descriptions with large language models (LLMs) conditioned on input text. However, such descriptions are often prone to the LLM's biases and hallucinations, and they lack an explicit objective and practical utility. In this work, we propose a novel framework for interpreting style representations through style-eliciting prompts: natural language instructions designed to steer LLMs to generate text that reflects specific stylistic attributes. We curate 1,010 distinct style features spanning 26 stylistic categories and construct a dataset by prompting an LLM to generate text conditioned on these features. Using this data, we train a decoder to generate a style prompt from the style representation of the generated text. We evaluate our approach on three tasks: (1) recovering original style prompts from generated text, (2) generating text in the same style using the recovered prompts, and (3) steering LLM outputs to match the style of human-written texts. Experiments demonstrate that our method consistently outperforms strong baselines that directly prompt LLMs with target text, achieving superior performance in both style description and style imitation. These results highlight that style-eliciting prompts can provide a practical and interpretable interface to stylistic information encoded in style representations.
