Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the task of AI-to-human text style transfer, creating a parallel corpus of 25k AI-generated and human-written text pairs. They fine-tune BART-base, BART-large, and Mistral-7B-Instruct models, evaluating them based on reference similarity and stylistic marker shift. Surprisingly, BART-large outperforms Mistral-7B in reference similarity despite having significantly fewer parameters, highlighting a potential "overshoot" issue with larger models in style transfer.
Bigger isn't always better: a smaller BART model rewrites AI text to sound more human than Mistral-7B, revealing that current style transfer metrics can be blind to "overshooting" the target style.
AI-generated text has become common in academic and professional writing, prompting research into detection methods. Less studied is the reverse: systematically rewriting AI-generated prose to read as genuinely human-authored. We build a parallel corpus of 25,140 paired AI-input and human-reference text chunks, identify 11 measurable stylistic markers separating the two registers, and fine-tune three models: BART-base, BART-large, and Mistral-7B-Instruct with QLoRA. BART-large achieves the highest reference similarity -- BERTScore F1 of 0.924, ROUGE-L of 0.566, and chrF++ of 55.92 -- with 17x fewer parameters than Mistral-7B. We show that Mistral-7B's higher marker shift score reflects overshoot rather than accuracy, and argue that shift accuracy is a meaningful blind spot in current style transfer evaluation.