Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
SHELDON decouples hypothesis generation from observation gathering, enabling exploration of novel hypotheses by actively seeking observations that current models cannot explain. This dual-space search strategy, inspired by scientific discovery principles, allows SHELDON to identify and address gaps in its understanding, leading to more comprehensive reasoning. Across diverse benchmarks, SHELDON significantly outperforms existing methods, discovering up to 4.5x more novel solutions.
Unexplained observations, not just supporting evidence, are the key to LLMs discovering truly novel hypotheses.
Test-time scaling has enabled LLMs to solve increasingly complex reasoning, discovery, and optimization tasks. However, existing approaches often gather observations while seeking evidence for current hypotheses, then generate new hypotheses conditioned on those hypotheses and their associated evidence. This couples observation discovery to existing hypotheses, favoring local refinements over exploration of unknown hypotheses regions. Inspired by the hypothetico-deductive method (Hempel, 1945) and dual-space models of scientific discovery (Klahr & Dunbar, 1988), we introduce SHELDON, a scientific reasoning harness that separately represents and jointly explores hypothesis and observation spaces. By actively seeking new observations along with new hypotheses, SHELDON can discover observations that its current hypotheses do not explain. These unexplained observations expose gaps in its understanding, motivate new investigations, and guide the generation of hypotheses beyond refinements of existing ones. Across diagnosis, abstract reasoning, and optimization benchmarks, SHELDON outperforms evaluated baselines by up to 26.7 points. Additional analysis shows that SHELDON generates up to 4.5x more novel solutions.
Stanford HAI