Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper analyzes the stylistic differences between LLM-generated text and human writing, identifying consistent patterns in the statistical distribution of n-grams. The findings reveal that LLMs exhibit a distinct textual "feel" and a more restricted semantic range compared to human authors. By demonstrating that higher-order n-grams are linked to semantic content, the study highlights the intertwined nature of style and semantics in LLM outputs.
LLMs exhibit a unique textual "feel" that starkly contrasts with human writing, revealing significant stylistic deficiencies.
Prior work on LLM-generated text has demonstrated quantitative and qualitative departures from text produced by humans. LLM-generated texts differ from human writing in style, resulting in a characteristic textual "feel," while the semantic range of LLMs is much restricted compared to that of humans. In this contribution, I note simple but consistent patterns in the statistical distribution of n-grams within LLM-generated text. Via qualitative analysis of these n-grams, I reveal deficiencies in LLM style. Because higher-order n-grams correlate to semantic content, I conclude that questions of style and semantics are not cleanly separable.