Search papers, labs, and topics across Lattice.
This paper introduces Claim-Normalized Citation Verification (CNCV), a novel three-stage framework that enhances citation verification by applying claim normalization strategies to raw citing claims before the retrieval and classification processes. The authors identify and address critical issues in traditional two-stage frameworks, such as scope and perspective mismatches, which hinder model performance. Their evaluation shows that CNCV significantly improves macro F1 scores by an average of 12% for encoders and 10% for generative LLMs, demonstrating that evidence quality is a key driver of classification performance.
Normalizing claims before verification can boost citation classification performance by over 10%, revealing the crucial role of evidence quality.
Citation accuracy has been studied for decades because of its importance to research reliability. Content-level citation verification assesses the reliability of scholarly claims. Recent work adopts a two-stage retrieval-classification framework inherited from fact-checking. However, this design overlooks the complexity of the raw citing claim and introduces three issues into the verification system, namely scope mismatch, perspective mismatch, and proposition entanglement. These issues increase the difficulty of retrieval and classification, thereby limiting model performance. Motivated by this gap, we propose claim normalization, which applies three rewriting strategies to the raw citing claim before retrieval and classification, allowing each downstream model to perform a single, well-defined task. Building on this method, we develop Claim-Normalized Citation Verification (CNCV), a new three-stage framework consisting of claim normalization, evidence retrieval with grounding, and citation classification. We evaluate CNCV across 18 classifiers using a factorial experiment on human-annotated citation instances. Compared with the prior two-stage framework, CNCV improves macro F1 by an average of 12% for encoders and 10% for generative LLMs, driven by improved evidence quality, the dominant factor identified in our experiments. Evidence retrieved from automatically normalized claims yields downstream classification performance statistically equivalent to that obtained with manually annotated evidence.
