Search papers, labs, and topics across Lattice.
The paper introduces Self-Audited Verified Reasoning (SAVeR), a framework for improving the faithfulness of reasoning in LLM agents by verifying internal belief states before action commitment. SAVeR generates diverse, persona-based candidate beliefs and uses adversarial auditing to identify and repair violations of logical or evidential constraints. Experiments across six benchmarks show that SAVeR enhances reasoning faithfulness without sacrificing task performance, mitigating the issue of unsupported beliefs propagating through long-horizon agentic systems.
LLM agents can be made more reliable by structurally verifying their internal reasoning, rather than relying on consensus which conflates agreement with faithfulness.
In large language model (LLM) agents, reasoning trajectories are treated as reliable internal beliefs for guiding actions and updating memory. However, coherent reasoning can still violate logical or evidential constraints, allowing unsupported beliefs repeatedly stored and propagated across decision steps, leading to systematic behavioral drift in long-horizon agentic systems. Most existing strategies rely on the consensus mechanism, conflating agreement with faithfulness. In this paper, inspired by the vulnerability of unfaithful intermediate reasoning trajectories, we propose \textbf{S}elf-\textbf{A}udited \textbf{Ve}rified \textbf{R}easoning (\textsc{SAVeR}), a novel framework that enforces verification over internal belief states within the agent before action commitment, achieving faithful reasoning. Concretely, we structurally generate persona-based diverse candidate beliefs for selection under a faithfulness-relevant structure space. To achieve reasoning faithfulness, we perform adversarial auditing to localize violations and repair through constraint-guided minimal interventions under verifiable acceptance criteria. Extensive experiments on six benchmark datasets demonstrate that our approach consistently improves reasoning faithfulness while preserving competitive end-task performance.
