Search papers, labs, and topics across Lattice.
This study investigates the coherence of predictive beliefs in large language models (LLMs) by analyzing their performance in multiple-choice question answering through a method called prompted predictive resampling (PPR). The researchers found that while LLMs initially exhibit belief drift, they eventually stabilize and converge to coherent predictive distributions after sufficient resampling. Their proposed strategies, including seed-answer prompting and a self-consistency loss, effectively mitigate early-stage drift and enhance predictive coherence while maintaining accuracy across various benchmarks.
Early belief drift in LLMs can be corrected through innovative resampling techniques, leading to a more stable and coherent predictive process.
Large language models (LLMs) are often hypothesized to perform implicit Bayesian inference, yet a key coherence condition, the martingale property of predictive beliefs, has been shown to fail in controlled synthetic in-context learning settings. We revisit this question in a more typical usage regime: generic multiple-choice question answering. Exploiting the discrete answer space, we compute exact predictive distributions and study belief dynamics induced by autoregressive answer resampling. We introduce prompted predictive resampling (PPR), where an LLM generates a sequence of answers to the same question. Empirically, PPR reveals early-stage belief drift, indicating martingale violations. However, after sufficient resampling steps, the belief process self-stabilizes and converges to a coherent predictive distribution. Based on this observation, we further propose (i) a seed-answer prompting strategy to accelerate stabilization, and (ii) a self-consistency loss that amortizes early-stage drift into the model via fine-tuning. Experiments on multiple-choice QA benchmarks show that our methods substantially reduce belief drift and improve predictive coherence without sacrificing accuracy.
