Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
We introduce a novel framework for adaptive generator-verifier loops to control false discoveries when a cheap proxy verifier approximates a costly ground-truth oracle. The method leverages $e$-values constructed via index betting and a new conformal risk control procedure for non-monotone losses to guarantee a controlled false discovery rate. This approach is validated on synthetic data and a protein design task, offering a principled way to terminate agentic workflows with high confidence.
Agentic loops can now reliably stop with provable guarantees on proposal quality, even with imperfect verifiers.
Numerous agentic workflows are based on a generator-verifier loop: a generator proposes candidates, a cheap verifier scores them, and the workflow terminates when a proposal is verified as good enough. The verifier typically proxies a more costly ground-truth oracle, and as the generator searches adaptively against it, false acceptances may accumulate. Proposals can pass the proxy but fail under the costlier ground-truth check. We study when to stop these loops while controlling the false discovery rate of the accepted proposals. Our construction introduces tools of independent interest in distribution-free statistical testing and conformal risk control, including analysis of $e$-values constructed through index betting and a novel conformal risk control procedure for non-monotone losses. We validate the approach in synthetic settings and on a protein-design benchmark.