Search papers, labs, and topics across Lattice.
The authors develop ProbPlug, a lightweight plugin that predicts output correctness for LLM-based binary classification without altering the underlying base model. Reliable confidence calibration remains a critical bottleneck for deploying foundation models in high-stakes decision pipelines where failure detection is essential. Across diverse text and vision-language benchmarks, ProbPlug consistently produces better-calibrated confidence estimates and improves classification performance while adding negligible computational overhead.
Foundation models already encode whether they are right or wrong: a lightweight attention layer over frozen internal token states reliably predicts classification errors across both text and multimodal domains.
Large language models (LLMs) have achieved strong performance across a broad range of classification settings, yet the reliability of their predictions remains a major obstacle to deployment in high-stakes scenarios. Although confidence estimation for LLMs has been widely studied, confidence calibration for LLM-based classification remains underexplored. We introduce ProbPlug, a lightweight confidence estimation framework for LLM-based binary classification, which predicts whether an output is correct using internal token features extracted from a frozen LLM. ProbPlug employs a self-attention module to aggregate hidden representations and can be integrated into the original inference pipeline without modifying the base model. Experiments across multiple tasks involving both text-based and multimodal large models show that ProbPlug provides more reliable confidence estimates, improves classification performance with negligible additional overhead, and exhibits strong generalization across tasks. These results indicate that ProbPlug serves as a practical solution for confidence estimation in LLM-based classification. Our code is publicly available at Github.
