Search papers, labs, and topics across Lattice.
This paper introduces DIPHINE, a novel neural estimator that utilizes score-based diffusion models to compute Integrated Information Decomposition ($Φ$ID$) for continuous non-Gaussian dynamical systems. By leveraging a single amortized network, DIPHINE estimates all mutual information terms necessary for $Φ$ID, allowing for the recovery of sixteen distinct information atoms through Möbius inversion. The method not only demonstrates superior performance on synthetic benchmarks compared to existing mutual information estimators but also successfully extracts interpretable information dynamics from real-world data without relying on distributional assumptions.
DIPHINE reveals the intricate information dynamics of complex systems, outperforming traditional methods and enabling insights from real-world data without distributional constraints.
Uncovering the true informational architecture of real-world complex systems requires disentangling how their components uniquely store, redundantly share, and synergistically integrate information over time. Integrated Information Decomposition ($Φ$ID) is a framework for decomposing the information dynamics of multivariate systems into sixteen non-overlapping atoms that characterize redundant, unique, and synergistic modes of information storage, transfer, and integration. Existing methods to compute $Φ$ID are restricted to Gaussian or discrete systems, preventing its application to continuous non-Gaussian dynamical systems. We address this limitation by proposing DIPHINE (Diffusion-based $Φ$-ID Neural Estimator), the first neural estimator that leverages score-based diffusion models to jointly estimate all the mutual information terms required by $Φ$ID from a single amortized network, recovering the sixteen atoms through Möbius inversion. We provide a theoretical analysis of error propagation through the inversion, showing that the Jacobian of the mapping from mutual informations to atoms is integer-valued and that the synergy-to-synergy atom is provably the hardest to estimate. We demonstrate accurate recovery of ground-truth atoms on synthetic benchmarks, superior performance compared to established mutual information estimators, and the ability to extract physiologically interpretable information-dynamic structure on an application involving real data without any distributional assumptions.
