Search papers, labs, and topics across Lattice.
This paper introduces calibrated verifier telemetry (CalVerT), which enhances LLM agents' decision-making in knowledge-intensive question answering by providing a calibrated self-confidence score and a grounding verifier score. By integrating this telemetry, agents can better discern when to retrieve additional information and when to rely on existing knowledge, thus mitigating issues of over-reliance on unsupported answers and unnecessary retrieval. The results demonstrate significant improvements in F1 scores across four QA benchmarks, showcasing CalVerT's effectiveness in both training-free and training-based settings.
CalVerT boosts QA performance by equipping agents with calibrated self-confidence and grounding scores, reducing both erroneous confident answers and unnecessary information retrieval.
LLM agents in knowledge intensive question answering take retrieval and reasoning actions with incomplete knowledge about whether their current answer is uncertain, unsupported, or already complete. This produces two failure modes: committing to confident but unsupported answers, which hurts accuracy, and over-retrieving when the evidence in hand already suffices, resulting in wasted compute. To give agents a more complete picture of the state space they are operating in, we introduce calibrated verifier telemetry (CalVerT), which augments the agent's state with additional telemetry: a calibrated self-confidence score and a grounding verifier score. We show that CalVerT can improve agents in both training-free and training-based settings. On four QA benchmarks, we find that CalVerT raises F1 by triggering retrieval in cases where agents over-rely on parametric knowledge, while cutting redundant retrieval in cases where agents have sufficient context to answer. We show that CalVerT can augment existing QA frameworks without training. Moreover, CalVerT also improves trained systems: by simply augmenting an agent's state with telemetry, we observe improvements after reinforcement learning, as compared to an agent with identical training but no CalVerT telemetry.
