Search papers, labs, and topics across Lattice.
This paper introduces Mechanistic World Models, a novel design paradigm that prioritizes reusable explanatory mechanisms in AI systems to facilitate scientific discovery. The authors argue that traditional predictive models fall short of fostering true understanding, which is essential for generating insights from observations. By outlining the computational capabilities and design principles necessary for such models, they provide a comprehensive framework that integrates various research directions, ultimately aiming to transition AI from mere prediction to autonomous discovery.
Mechanistic World Models could redefine how AI systems achieve scientific discovery by centering on explanatory mechanisms rather than just predictions.
Recent advances in foundation models have transformed AI for Science, enabling remarkably accurate predictive performance across domains ranging from protein folding to weather forecasting. Yet prediction alone does not constitute scientific discovery. Scientific understanding depends on uncovering the reusable explanatory mechanisms that generate observations, whereas contemporary machine learning remains fundamentally organised around predictive mappings rather than explanatory structure. In this paper, we argue that scientific discovery is fundamentally a problem of knowledge organisation. To this end, we introduce Mechanistic World Models, a new design paradigm that places reusable mechanisms at the centre of representation, computation and learning. Drawing on insights from the philosophy of science, we derive the computational capabilities required for discovery, identify the design principles and inductive pressures that encourage explanatory knowledge to emerge, and formalise the anatomy of a mechanism-centric world model. Finally, we show how diverse research directions including mechanistic interpretability, causal representation learning, equation discovery and modular architectures capture complementary ingredients of this paradigm while lacking a unified framework. We propose Mechanistic World Models as a conceptual foundation and computational blueprint for moving AI beyond predictive forecasting towards autonomous scientific discovery.
