Search papers, labs, and topics across Lattice.
This study investigates the distinct axes of answer correctness and question answerability in large language models (LLMs), revealing that traditional confidence scoring fails to differentiate between answerable and unanswerable questions. By employing a linear probe on hidden states, the authors demonstrate that models can represent unanswerable questions without reporting them, particularly in cases with false premises. The proposed calibrated policy effectively manages both axes, achieving a significant improvement in the controllability of unanswerable-answer rates while maintaining high accuracy in correct answers across various model sizes.
Models can misrepresent unanswerable questions, but a new calibrated policy allows for precise control over when they should answer.
A model should refuse two different things: answers it would get wrong, and questions it should not answer at all, such as unanswerable ones or ones resting on a false premise. The usual recipe thresholds a single confidence score, which cannot tell these apart. Across five instruction-tuned models from three families (2B to 14B), we find they are separate axes. Ordinary answer-confidence tracks whether an answer is right but is nearly blind to whether the question is answerable; a linear probe on hidden states does the reverse. The blind spot does not shrink with scale. It is worst on naturally occurring false-premise questions (CREPE). There, answer-confidence, P(IK), P(True), and even asking the model outright whether a premise is false all stay near chance, while a hidden-state probe reaches 0.69 to 0.77 AUROC: the model represents a problem it will not report. This turns out to be fixable. Instructing a model to check premises backfires, because it then disputes sound and false premises alike (57% false challenges), unable to tell them apart; routing the same instruction with the probe roughly triples challenge precision. We turn the two axes into a calibrated policy that answers only when an answerability score and a correctness score each clear a separately certifies behave differently: the unanswerable-answer rate is controllable at every scale, while the wrong-answer rate is capped by model accuracy, so the guarantee tightens as threshold policy certifies both budgets at 0.75 coverage of correct answers, against 0.31 for a single threshold; at 14B it is the only policy that certifies at all.
