Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a quantitative framework for evaluating narrative quality by extracting 33 linguistic features across lexical, syntactic, and semantic dimensions. The framework was tested on a corpus of 23 books, successfully clustering narratives by publication quality and outperforming traditional story-level metrics when compared to human annotations. This demonstrates the efficacy of quantitative linguistic analysis in assessing narrative quality.
Forget subjective judgments – this quantitative framework uses 33 linguistic features to accurately distinguish professionally edited narratives from self-published ones.
The evaluation of narrative quality remains a complex challenge, as it involves subjective factors such as plot, character development, and emotional impact. This work proposes a quantitative approach to narrative assessment by focusing on the linguistic dimension as a primary indicator of quality. The paper presents a methodology for the automatic evaluation of narrative based on the extraction of a comprehensive set of 33 quantitative linguistic features categorized into lexical, syntactic, and semantic groups. To test the model, an experiment was conducted on a specialized corpus of 23 books, including canonical masterpieces and self-published works. Through a similarity matrix, the system successfully clustered the narratives, distinguishing almost perfectly between professionally edited and self-published texts. Furthermore, the methodology was validated against a human-annotated dataset; it significantly outperforms traditional story-level evaluation metrics, demonstrating the effectiveness of quantitative linguistic features in assessing narrative quality.