Search papers, labs, and topics across Lattice.
This paper introduces Budgeted Conformal Evidence Acquisition (BCEA), a novel approach that enhances the reliability of large vision-language models (LVLMs) by allowing them to selectively acquire additional visual evidence instead of simply abstaining from uncertain claims. The authors demonstrate that traditional conformal filtering methods, which require high abstention rates to maintain low hallucination rates, can be improved by integrating a three-way decision-making process that includes evidence acquisition. BCEA not only maintains a hallucination rate below 5% but also improves coverage on various benchmarks, effectively balancing the trade-off between risk and information gain.
Abstaining from uncertain claims is wasteful when additional visual evidence can be efficiently acquired, and our BCEA approach proves it can enhance both reliability and coverage in LVLMs.
Large vision-language models (LVLMs) hallucinate: they assert visual details that the image does not support. A principled remedy is selective prediction with a distribution-free guarantee-verify each claim and abstain when the claim is not grounded, so that the hallucination rate among asserted claims is provably bounded. We show, however, that this guarantee is bought at a brutal price: to keep the hallucination rate below $5\%$ on a balanced object-existence benchmark, a state-of-the-art conformal filter must abstain on more than $80\%$ of claims. We argue that abstention is wasteful when more visual evidence is cheaply available, and introduce Budgeted Conformal Evidence Acquisition (BCEA), which replaces the binary answer/abstain decision with a three-way choice: answer, abstain, or acquire additional visual evidence by re-examining the image (zooming, cropping, or applying a claim-specific intervention) under a bounded compute budget. We make two observations. First, acquisition that is plugged naively into a calibrated filter breaks the statistical guarantee -- realized risk overshoots the target by up to $17$ points -- because the acquisition step destroys the exchangeability that conformal calibration relies on. Second, folding the entire acquisition policy into the score function and re-calibrating on post-acquisition scores \emph{restores} the finite-sample guarantee while still recovering coverage. BCEA further uses structured, claim-type-specific interventions. Across the POPE benchmark and COCO-constructed existence and spatial-relation claims, on four open VLMs, BCEA controls the hallucination rate at the target level and consistently improves coverage over a guaranteed-abstention baseline.
