Search papers, labs, and topics across Lattice.
This paper introduces SVI-DAG, a structured variational inference method for Bayesian causal discovery that effectively models dependencies between edges in directed acyclic graphs (DAGs) using normalizing flows. By incorporating observational data and prior beliefs, SVI-DAG addresses the limitations of existing approaches, particularly in handling identifiability issues and leveraging domain knowledge. The evaluation against five state-of-the-art methods shows that SVI-DAG excels in uncertainty quantification while maintaining competitive structural accuracy.
SVI-DAG outperforms existing Bayesian methods by effectively quantifying uncertainty in causal inference while leveraging prior knowledge and edge dependencies.
Bayesian causal discovery seeks to determine the posterior distribution of causal theories, which are interpreted as directed acyclic graphs (DAGs) that explain the observed data. The resulting posterior allows systematic reasoning regarding epistemic uncertainty within these theories. Nonetheless, finding such graphs is difficult due to identifiability problems and limited observational data. Furthermore, precisely approximating posterior over graphs is challenging given vast range of potential DAGs. Recent Bayesian approaches have addressed some of these challenges, yet they remain limited as they fail to encode dependencies between edges, and lack principled ways to incorporate domain knowledge as inductive biases during the search process. To overcome these limitations, we propose SVI-DAG, a structured variational inference approach to Bayesian causal discovery using observational data and prior beliefs that uses normalizing flows to model dependencies between edges, supporting expressive and multimodal posterior learning over DAGs. To mitigate mode seeking behaviour in evidence lower bound optimization and promote mode coverage, we use stein variational gradient descent to update the node potentials using a kernel in acyclicity space. We evaluate SVI-DAG against 5 state-of-the-art Bayesian DAG learning methods and demonstrate superior performance in uncertainty quantification while remaining competitive in terms of structural accuracy.