Search papers, labs, and topics across Lattice.
The paper introduces LitSeg, a narrative-aware document segmentation framework for literary RAG that uses multi-stage prompting to extract events, untangle narrative threads, and identify turning points. To improve efficiency, they also present LitSeg-Lite, a distilled single-pass chunker fine-tuned on LitSeg-generated data. Experiments show that LitSeg and LitSeg-Lite significantly improve retrieval accuracy, context relevance, and downstream QA performance compared to semantically blind baselines.
Literary RAG gets a plot twist: narrative-aware segmentation boosts QA performance by untangling narrative threads, outperforming semantically blind methods.
Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge, particularly for long-tail domains such as literary works. However, the critical step of document segmentation in RAG remains largely underexplored. Existing strategies are typically semantically blind and overlook the complicated narrative structures of literary works, often resulting in fragmented plots and unclear references that severely hinder retrieval and generation performance. To address this, we propose LitSeg, a novel narrative-theory-guided segmentation framework. By employing multi-stage prompting, LitSeg explicitly extracts valid events, untangles narrative threads, clarifies narrative structures, and locates turning points to inform segmentation. To alleviate the computational overhead of multi-stage inference with large-scale models, we further introduce LitSeg-Lite, a lightweight single-pass chunker fine-tuned on LitSeg-generated data via a two-stage training strategy, distilling the complex process into a single inference pass. Extensive experiments demonstrate that with structurally independent text chunks, our methods significantly improve retrieval accuracy and context relevance over baselines, ultimately enhancing downstream QA performance, while ablation studies validate the efficacy of narratological guidance and data distillation.