Search papers, labs, and topics across Lattice.
This paper introduces a risk-controlled framework for using large language models (LLMs) as judges in evaluating model outputs, particularly for objective tasks where reference answers are absent. By calibrating uncertainty thresholds and employing a two-threshold routing mechanism, the framework ensures that the false discovery rate among accepted verdicts remains below a specified level while improving coverage compared to traditional single-mode approaches. The results demonstrate that this method maintains target error rates across various open-domain QA benchmarks, effectively balancing efficiency and reliability in LLM judging.
A novel two-threshold framework allows LLMs to judge outputs with formal control over reliability, achieving higher coverage without compromising error rates.
Using LLMs as judges has become standard practice for evaluating model outputs at scale. This is particularly common for subjective, open-ended tasks such as assessing helpfulness or alignment, where no single reference answer exists. However, objective tasks introduce a distinct reliability challenge for reference-free LLM judging. In the absence of a reference answer, the judge evaluates factual correctness either through its parametric knowledge or through tool augmentation. Although the former enables efficient evaluation, the judge may hallucinate or lack sufficient evidence for its verdict. Conversely, tool augmentation can provide additional evidence but introduces extra computational cost and requires an appropriate mechanism to determine when and how that evidence should be used reliably. More importantly, neither approach alone provides formal control over the risk of accepted verdicts or guarantees their reliability at a specified level. We propose a risk-controlled framework that calibrates uncertainty thresholds on a held-out set so that the false discovery rate among accepted verdicts remains below a user-specified level~$\alpha$ with high probability, using finite-sample Clopper--Pearson intervals. When the parametric mode is not sufficiently confident, the instance is routed to a retrieval-augmented mode, where the judge gathers web evidence and re-evaluates the instance under a second calibrated threshold. The finite-sample guarantee carries over to this two-threshold routing without additional assumptions. Across open-domain QA benchmarks and judges of varying scales, the framework maintains the target error rate while achieving substantially higher coverage than single-mode baselines.
