Search papers, labs, and topics across Lattice.
This paper introduces CoMet, a novel method for uncertainty estimation in multimodal large language models (MLLMs) that decomposes uncertainty into context-specific and multiplicity-specific components. By training a lightweight post-hoc uncertainty module, CoMet efficiently quantifies uncertainty without the need for autoregressive generation or repeated sampling, addressing the complexities of open-ended tasks. Experimental results demonstrate that CoMet significantly outperforms existing baselines in uncertainty estimation across various multimodal benchmarks, enhancing both performance and efficiency.
CoMet reveals that decomposing uncertainty into context and multiplicity components can lead to substantial improvements in uncertainty estimation for multimodal AI systems.
Uncertainty estimation has been a long-standing challenge in AI models; it amounts to "knowing what you don't know," and metacognition is notoriously difficult even for humans (cf. the Dunning-Kruger effect). Although it is still far from solved even in simpler classification systems, tackling it in multimodal large language models (MLLMs) is becoming increasingly important. Within MLLMs, uncertainty can stem from any of the diverse sources as well as from their relationships, and further can stem from the unbounded answers in the open-ended setting. To tackle the issues, we propose CoMet, an MLLM uncertainty estimation method by decomposing uncertainty into a context-specific term and a multiplicity-specific term. The former captures ambiguity induced by the given context (e.g., task or prompt), while the latter captures how many plausible answers determined by the context remain compatible with the given input. We train a lightweight post-hoc uncertainty module to estimate these quantities, which enables efficient uncertainty estimation without autoregressive answer generation or repeated sampling. Experiments on various open-ended multimodal benchmarks, hallucination detection, and multiple-choice visual question answering benchmarks show that CoMet consistently improves uncertainty estimation over existing baselines while remaining efficient in practice. Code is available at https://github.com/princetonvisualai/comet_uncertainty
