Search papers, labs, and topics across Lattice.
This paper introduces Large Language Gibbs, a novel method for structured probabilistic inference that leverages the conditional distributions of large language models (LLMs) as transition operators. By iteratively resampling individual variables conditioned on others, rather than relying on single-pass autoregressive generation, the approach mitigates order-dependent biases and achieves a stationary distribution that balances local conditionals. The method demonstrates effectiveness across various applications, including synthetic distributions, consistent reasoning tasks, and Bayesian structure learning, highlighting its practicality for structured inference in complex domains.
Iterative resampling with LLM conditionals can outperform traditional autoregressive generation in structured probabilistic inference.
The knowledge encoded in large language models (LLMs) can serve as a substrate for structured reasoning over variables describing a complex world, but accessing this knowledge in a probabilistically coherent manner poses a difficult inference problem. We propose Large Language Gibbs, a scheme for structured probabilistic inference that uses conditional distributions of an LLM as transition operators. Rather than sampling structured objects through single-pass autoregressive generation, we iteratively resample individual variables conditioned on others using an LLM's next-token conditionals. This approach avoids order-dependent biases and produces a stationary distribution that reflects a compromise between all local conditionals. We apply this approach to sampling from synthetic distributions, consistent reasoning tasks, and Bayesian structure learning. The results suggest that the use of LLM conditionals in MCMC is a practical alternative to one-pass generation for structured probabilistic inference under a world prior accessible through noisy LLM conditionals.
