Search papers, labs, and topics across Lattice.
This paper introduces Structural Causal Bottleneck Models (SCBMs), a new class of structural causal models that assumes causal effects between high-dimensional variables depend on low-dimensional summary statistics (bottlenecks) of the causes. The authors analyze identifiability in SCBMs, relate them to information bottlenecks, and show they can be estimated using standard learning algorithms. Experiments demonstrate the benefit of bottlenecks for effect estimation in low-sample transfer learning, positioning SCBMs as an alternative to causal representation learning and causal abstraction learning.
Causal effects between high-dimensional variables may be simpler than you think: they often depend only on low-dimensional summary statistics, or bottlenecks, of the causes.
We introduce structural causal bottleneck models (SCBMs), a novel class of structural causal models. At the core of SCBMs lies the assumption that causal effects between high-dimensional variables only depend on low-dimensional summary statistics, or bottlenecks, of the causes. SCBMs provide a flexible framework for task-specific dimension reduction while being estimable via standard, simple learning algorithms in practice. We analyse identifiability in SCBMs, connect them to information bottlenecks in the sense of Tishby & Zaslavsky (2015), and illustrate how to estimate them experimentally. We also demonstrate the benefit of bottlenecks for effect estimation in low-sample transfer learning settings. We argue that SCBMs provide an alternative to existing causal dimension reduction frameworks like causal representation learning or causal abstraction learning.
