Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper trains a language model to forecast real-world events by learning to search for evidence dynamically during rollout, addressing the limitation of prior work that either froze context or only deployed search at test time. Using a novel agentic forecasting environment with over 2,100 Polymarket questions and layered leak filtering, a Qwen3.5-35B-A3B model trained with GRPO under a Brier-score reward demonstrated improved calibration and reduced search attempts. The trained agent significantly outperformed frontier models, including Claude Opus 4.5, on evidence-based forecasting, particularly on difficult questions, at a fraction of the inference cost.
A single-epoch GRPO training regime on a novel agentic forecasting environment transforms LLMs into evidence-disciplined forecasters that outperform frontier models on complex real-world predictions at 5% of inference cost.
Outcome-based reinforcement learning can train language models to forecast real-world events, but prior forecasting work either freezes research context before training or deploys agentic research only at test time, so the skill of gathering evidence is never shaped by the reward. We introduce an agentic forecasting environment, dataset, and harness built from 2,100+ resolved Polymarket questions; the agent acquires its own context at rollout time (web search, page reading, and financial time series, all restricted by layered leak filtering to information published before each question's cutoff), and we train Qwen3.5-35B-A3B (3B active parameters) on it with single-epoch GRPO under a Brier-score reward. Training changes how the agent interacts with information: calibration improves 30-40%, and search attempts fall from 3.8 to 2.25 per rollout as evidence discipline is learned. Evaluated in an identical harness against four frontier models, the trained policy also finishes ahead of every frontier model tested at evidence-based forecasting, including Claude Opus 4.5 (soft-Brier 0.254 vs. 0.256, n=265), at about 5% of the inference cost, and its margin is widest on the hardest questions, the ones the crowd itself had not decided. We release the environment, dataset, and per-rollout records as a reusable harness for temporal forecasting agents.