Search papers, labs, and topics across Lattice.
This paper investigates the "representation-confidence gap" in diffusion language models, revealing that while these models accurately detect text errors internally, their external confidence scores remain misleadingly high even as accuracy declines due to noise. The study demonstrates that this gap leads to a degradation in the ability to rank answers correctly, favoring standard models in noisy conditions. A novel extraction tool is introduced that leverages internal signals to improve ranking without altering the base model, highlighting the importance of certainty reliability over mere accuracy in these contexts.
High confidence scores in diffusion language models can mask significant ranking failures, revealing a critical gap between internal error detection and external performance.
Diffusion language models use broad context to create text, suggesting they might handle input noise better than standard models. Testing reveals this is only partially true. Internally, diffusion models detect text errors highly accurately. Externally, their reported certainty ignores this signal. As accuracy drops due to noise, confidence stays near its maximum and the ability to correctly rank answers degrades toward random chance. We call this mismatch the representation confidence gap. The visible concentration of high certainty scores is a misleading surface symptom. Standard math adjustments remove this concentration but fail to fix the underlying loss of ranking order. This ranking deficit favors standard models under noisy conditions and resists common remedies. Matching training recovers accuracy but not ranking, while score recalibration and input level error signals cannot reorder the final answers. However, the information needed to properly evaluate an answer survives in the hidden states. A lightweight extraction tool uses this signal to improve ranking. This approach is highly efficient because it leaves the base model completely frozen and requires zero additional text generation steps. We present this tool to prove the signal exists, while clearly noting its limits. Ultimately, certainty reliability is a more pressing limit than overall accuracy under noisy conditions.
