Search papers, labs, and topics across Lattice.
This paper introduces FACTOR, an inference-time model that tailors verification efforts based on the uncertainty of factual claims generated by large language models. By integrating uncertainty estimation, adaptive language inference verification, and candidate re-ranking, FACTOR enhances the factual accuracy of long-form text while simultaneously reducing the costs associated with verification. Evaluated on the FactScore benchmark, the results demonstrate that FACTOR significantly improves factuality without compromising efficiency, showcasing its model-agnostic applicability.
Adaptive verification can drastically cut down on the cost of ensuring factual accuracy in long-form generation by focusing on the riskiest claims.
Large Language Models (LLMs) generate fluent long-form text, however, often add unsupported factual claims. Existing verification techniques improve factuality by grounding generation in external evidence. However, the same verification policy usually applies to all claims despite being differences in hallucination risks. We propose \textit{FACTOR} (\textit{FACTuality-Oriented Risk-aware Verification}), an inference-time model that adapts verification criteria according to claim-level uncertainty. FACTOR combines uncertainty estimation, adaptive language inference verification, and candidate re-ranking to allocate verification effort where it is most needed. We evaluate \textit{FACTOR} on FactScore benchmark showing that adaptive verification improves factuality while reducing verification cost simultaneously. We further perform different ablation studies to identify the primary driver of these gains. Our results show the effective and model-agnostic performance of \textit{FACTOR} for improving factuality in long-form generation.
