Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates whether BERT embeddings encode narrative dimensions (time, space, causality, and character) in fiction. They create a token-level dataset labeled with these dimensions using LLM-accelerated annotation and train a linear probe on BERT embeddings to predict these labels. The probe significantly outperforms a random baseline, achieving a macro-average recall of 0.83, indicating that BERT encodes meaningful narrative information, although with "boundary leakage" between categories.
BERT's understanding of narrative time, space, causality, and character is surprisingly good, but struggles to cleanly separate these dimensions, revealing limitations in how it represents complex semantic structures.
Narrative understanding requires multidimensional semantic structures. This study investigates whether BERT embeddings encode dimensions of fictional narrative semantics -- time, space, causality, and character. Using an LLM to accelerate annotation, we construct a token-level dataset labeled with these four narrative categories plus "others." A linear probe on BERT embeddings (94% accuracy) significantly outperforms a control probe on variance-matched random embeddings (47%), confirming that BERT encodes meaningful narrative information. With balanced class weighting, the probe achieves a macro-average recall of 0.83, with moderate success on rare categories such as causality (recall = 0.75) and space (recall = 0.66). However, confusion matrix analysis reveals "Boundary Leakage," where rare dimensions are systematically misclassified as "others." Clustering analysis shows that unsupervised clustering aligns near-randomly with predefined categories (ARI = 0.081), suggesting that narrative dimensions are encoded but not as discretely separable clusters. Future work includes a POS-only baseline to disentangle syntactic patterns from narrative encoding, expanded datasets, and layer-wise probing.