Search papers, labs, and topics across Lattice.
This paper introduces PEARL, a training-free framework designed to transform noisy outputs from large language models (LLMs) into auditable scientific reasoning graphs. By leveraging a closed Peircean schema and evidence-grounded feedback, PEARL effectively repairs malformed graph structures, resulting in a significant increase in the accuracy of reasoning chains extracted from scientific papers. The framework demonstrates a remarkable improvement in strict gate passes from 0/350 to 300/350, with a corresponding rise in average reasoning effectiveness from 0.339 to 0.906 across five benchmark model archives.
PEARL transforms chaotic LLM outputs into reliable, auditable reasoning graphs, achieving a staggering 300/350 accuracy in scientific reasoning extraction.
Scientific Reasoning Graph Extraction (SRGE) aims to recover explicit links among observations, evidence, intermediate claims, and paper-level conclusions. LLMs can produce graph-like scientific explanations, but their outputs often mix malformed syntax, drifting edge labels, incorrectly oriented roots, and weak source anchors. We propose PEARL (Peircean Extraction via Abstraction and Repair Layer), a training-free framework that turns noisy LLM graph responses into auditable reasoning graphs and repairs them toward strict semantic validity. PEARL first materializes explicit graph content under a closed Peircean schema, then uses matched evidence-grounded judge feedback to repair rejected edge types, local inference steps, and terminal roots while preserving an audit trail. On five 70-paper model archives from ARCHE, a benchmark for latent reasoning-chain extraction, PEARL raises strict gate passes from 0/350 for the LLM baseline to 300/350, with average REA improving from 0.339 to 0.906. The graphs provide a reliability layer for research-agent and AI scientist workflows that need inspectable reasoning traces rather than unconstrained graph regeneration. Code and audit artifacts are available at https://github.com/BohanSu/auditable-repair-reasoning-graphs/tree/300-350_workshop .
