Search papers, labs, and topics across Lattice.
This paper introduces EG-VAR, a Lean 4-based architecture that ensures empirical reasoning in LLMs is grounded in verifiable evidence through tool-attestation axioms and kernel-checked inference. By achieving a perfect score on a numerical reasoning benchmark and maintaining source fidelity under stress tests, EG-VAR significantly reduces the risk of hallucinations in LLM outputs. The framework not only audits claims but also transforms potential errors and ambiguities into explicit targets for improvement, paving the way for more reliable AI systems in high-stakes contexts.
Achieving 100% accuracy in empirical reasoning while maintaining source fidelity, EG-VAR redefines how we can eliminate hallucinations in LLM outputs.
Tool access alone does not make LLM empirical reasoning governable: accepted outputs need not descend from attested evidence, and accepted deductions need not hold up under formal scrutiny. We present EG-VAR (Evidence-Grounded Verified Agentic Reasoning), a Lean 4-based tool-calling architecture in which the Lean kernel is the sole minter of Verified claims via tool-attestation axioms and declared source lifts. Every verified output structurally descends from an attested tool call (Thm. 3.1) and a kernel-checked chain of valid inference (Thm. 3.2); residual outputs are honest Abstain with a replayable audit trail. On a subcollection of TableBench numerical reasoning (n=120), EG-VAR attains 120/120 versus a 95% same-tool baseline; on counterfactual stress tests (5 domains x 2 models), EG-VAR stays 100% source-faithful while same-tool drops to 80-90% (no-tool 50-80%). With the LLM as deployment-time formalizer, residual semantic-formalization error is 3.3% on Sonnet and 1.7% on Opus. We position EG-VAR as a technical-governance interface for high-stakes empirical claims: a formal sidecar makes the target proposition, source scope, evidence boundary, proof obligation, and abstention condition auditable, eliminating unsupported Verified outputs today while turning formalization errors, lift and source-authority disputes, ambiguities, and abstentions into explicit audit targets. Over time, typed sidecars in datasets, APIs, public records, and AI-generated documents can amortize this formalization burden into reusable infrastructure.
