Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study reveals that the Flesch Reading Ease (FRE) and Flesch-Kincaid Grade Level (FKGL) scores for long texts are primarily determined by the document's topic distribution rather than its lexical composition. By employing a topic model with an explicit sentence-boundary token, the authors demonstrate that in the long-text limit, variations in readability scores are mediated solely by topical composition. Experimental results show strong predictive correlations between inferred topic vectors and FKGL scores across two balanced corpora, indicating that traditional readability measures may not capture the underlying factors influencing readability in lengthy documents.
Readability scores like FKGL are more about topic distribution than word choice, challenging traditional assumptions about text comprehension.
Flesch Reading Ease (FRE) and the Flesch-Kincaid Grade Level (FKGL) are widely used readability scores for English computed from the same two document statistics, yet their stability on long documents need not imply invariance to lexical composition. Surprisingly, under a topic model with an explicit sentence-boundary token, both scores converge almost surely to deterministic functions of the document topic distribution through just two scalar rates: in the long-text limit, all score variation is mediated by topical composition rather than any residual readability signal. The theory covers both formulae, while the experiments evaluate FKGL. In a fixed admixture with rank[1, q, s] = 3, fibres through interior topic vectors are locally (K-3)-dimensional, whereas regular iso-score level sets are locally (K-2)-dimensional and curved. In out-of-fold evaluation on two balanced corpora, Brown and the written BNC, a topic vector inferred from one document half's content words predicts the other half's FKGL at r = 0.779 and 0.884, respectively. On Brown, adding the topic prediction to genre and mean content-word syllable count yields $\Delta R^2$ = 0.002, with a confidence interval spanning zero; on the BNC, the corresponding split-half increment is 0.024, positive in four of five K = 100 fits (median 0.021). Because inferred topics may also absorb genre, register, and style, we do not interpret these results as evidence about human readability or causal effects.