Search papers, labs, and topics across Lattice.
This paper introduces the Causal Discovery Foundation Model (CDFM), a unified framework designed for zero-shot structural inference in causal discovery, addressing the limitations of dataset-specific approaches. By investigating causal identifiability and leveraging a variational framework that treats unknown causal mechanisms as latent variables, CDFM achieves reliable generalization across diverse domains. Extensive experiments show that CDFM outperforms traditional causal discovery algorithms, marking a significant shift toward scalable and adaptable causal inference methods.
CDFM outperforms traditional causal discovery algorithms by leveraging a unified framework that adapts to diverse datasets without the need for extensive retraining.
Causal discovery, the process of recovering underlying causal structures from observational data, is a fundamental pursuit across scientific disciplines. Over the past decades, numerous algorithms have been developed to tackle this challenge through workflows tailored to the specific causal mechanisms underlying each type of dataset, demonstrating effectiveness across a wide range of applications. However, as the volume and heterogeneity of real-world data continue to grow, this dataset-specific approach inevitably leads to a fragmented, test-driven paradigm that struggles to scale to the demands of modern scientific discovery. To address this, we formulate the Causal Discovery Foundation Model (CDFM) as a unified, general-purpose framework for zero-shot structural inference. To ensure reliable generalization across unknown domains, we first investigate the theoretical boundaries of causal identifiability, revealing the indispensable role of causal prior mechanisms in this process. Building on these insights, we formulate a principled variational framework that treats unknown causal mechanisms as latent variables and mathematically decomposes the intractable marginal likelihood into distinct, tractable learning modules. The variational decomposition provides a conceptual design principle for the architecture design of CDFM, while comprehensive causal knowledge guides the large-scale synthesis of our pretraining data. By pretraining on a massive, highly diverse space of synthetic structural causal models, CDFM successfully internalizes complex statistical asymmetries. Extensive experiments demonstrate that CDFM consistently outperforms traditional algorithms, driving a paradigm shift toward a general-purpose causal discovery foundation model.
Tsinghua AI