Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces persistent cross entropy (PCE), a novel extension of cross entropy tailored for persistence diagrams by utilizing an induced probability that bridges differing event spaces. The significance of this work lies in its ability to distinguish between persistence diagrams that share the same persistent entropy, thereby offering a new tool for analyzing causal relationships in dynamical systems. The authors validate PCE through three numerical studies, demonstrating its effectiveness in separating causal directions and its utility as a directional topology loss in knowledge distillation.
Persistent cross entropy can differentiate between persistence diagrams with identical persistent entropy, unlocking new insights in causal inference and knowledge distillation.
Persistent entropy is the Shannon entropy of a persistence-based probability measure defined on a persistence diagram. However, its cross-entropy version is not naturally defined because two persistence diagrams generally have different event spaces. To bridge these event spaces, we combine a similarity function with persistence weighting to define an induced probability. The induced probability reflects information from one diagram on the event space of the other diagram and assigns unexplained probability mass to the unexplained event. Using the induced probability, we extend cross entropy to persistence diagrams, called persistent cross entropy (PCE). We establish the main properties of both the induced probability and PCE and prove stability theorems for both. Through three numerical studies, we show that PCE distinguishes diagrams with the same persistent entropy, separates causal directions in dynamical systems without constructing a joint persistent diagram, and can be used as a directional topology loss for knowledge distillation.