Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Bayesian Linguistic Forecaster (BLF), an agentic system designed for binary forecasting that leverages a semi-structured Bayesian belief state to integrate numerical probabilities with natural-language evidence. By employing hierarchical multi-trial aggregation and calibration techniques, BLF significantly outperforms leading forecasting models on the ForecastBench benchmark, demonstrating the efficacy of its structured approach. Ablation studies reveal that the belief state is as impactful as web search access, while the proposed aggregation and calibration methods provide substantial performance enhancements.
BLF achieves state-of-the-art forecasting accuracy by integrating Bayesian belief states with innovative aggregation and calibration techniques, outperforming top models like GPT-5 and Grok~4.20.
We present BLF (Bayesian Linguistic Forecaster), an agentic system for binary forecasting that achieves state-of-the-art performance on the ForecastBench benchmark. The system is built on three ideas. (1) A Bayesian linguistic belief state: a semi-structured representation combining numerical probability estimates with natural-language evidence summaries, updated by the LLM at each step of an iterative tool-use loop. This contrasts with the common approach of appending all retrieved evidence to an ever-growing context. (2) Hierarchical multi-trial aggregation: running $K$ independent trials and combining them using logit-space shrinkage with a data-dependent prior. (3) Hierarchical calibration: Platt scaling with a hierarchical prior, which avoids over-shrinking extreme predictions for sources with skewed base rates. On 400 backtesting questions from the ForecastBench leaderboard, BLF outperforms all the top public methods, including Cassi, GPT-5, Grok~4.20, and Foresight-32B. Ablation studies show that the structured belief state is as impactful as web search access, and that shrinkage aggregation and hierarchical calibration each provide significant additional gains. In addition, we develop a robust back-testing framework with a leakage rate below 1.5\%, and use rigorous statistical methodology to compare different methods while controlling for various sources of noise.