Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces HistoRAG, a novel framework that integrates historiographical principles into Retrieval-Augmented Generation (RAG) to better align with the interpretive needs of historical studies. Key architectural interventions include separating retrieval from generation, implementing temporal windowing for balanced source representation, and utilizing LLM-as-judge evaluations to enhance transparency in relevance judgments. Evaluations on a large dataset from Der Spiegel reveal significant deficiencies in standard RAG configurations, highlighting the importance of era-specific vocabulary and the need for complementary retrieval strategies to improve scholarly practice in historical inquiry.
HistoRAG reveals that standard RAG frameworks can misrepresent historical contexts, leading to significant gaps in relevant source retrieval.
Retrieval-Augmented Generation (RAG) is the prevailing architecture for grounding language model outputs in external evidence, yet its dominant evaluation paradigms and default configurations remain oriented toward factual question-answering. For interpretive disciplines such as historical studies, RAG embeds assumptions that conflict with scholarly practice. We introduce HistoRAG, a framework that translates historiographical principles into concrete architectural interventions. Separated retrieval and generation decouples source discovery from interpretation, temporal windowing enforces balanced source representation across the research period as a methodological requirement of historical inquiry, and LLM-as-judge evaluation makes relevance judgments transparent and contestable. We evaluate these interventions using SPIEGELragged, applied to 102,189 articles from Der Spiegel (1950-1979). Each intervention addresses a measurable deficiency in standard RAG: era-specific vocabulary retrieves zero chunks from the 1950s when using 1970s terminology, evidence of the temporal skew that motivates windowing; vector similarity and LLM-assessed relevance correlate only weakly (Spearman rho = 0.275), motivating post-retrieval evaluation; and keyword-based and semantic retrieval surface largely disjoint source pools, motivating an architecture in which both operate as complementary retrieval layers under a shared LLM evaluation filter. We also introduce the concept of Zwischentexte (intermediate texts that function as interpretive proposals rather than findings) as a framework for responsible integration of LLM-generated text into scholarly practice. The architecture offers a model for how domain-specific epistemological commitments can be translated into RAG design decisions, and may transfer to other interpretive disciplines working with large corpora.