Search papers, labs, and topics across Lattice.
This paper introduces a unified topological framework for analyzing neural representations through the development of Symmetric Representation Topology Divergence (SRTD) and Normalized Topological Similarity (NTS). By addressing the limitations of existing topological divergences, SRTD provides a comprehensive cross-barcode signature for precise structural diagnosis, while NTS offers a scale-invariant metric for reliable benchmarking across diverse scenarios. Experiments reveal that this toolkit effectively captures functional shifts in CNNs and maps LLM genealogy, outperforming traditional geometric measures in robustness and accuracy.
A new topological framework reveals structural discrepancies in neural representations that traditional methods miss, enhancing both diagnosis and benchmarking.
Topological Data Analysis (TDA) offers a principled, intrinsic lens for comparing neural representations. However, existing paired topological divergences (e.g., RTD) are limited by heuristic asymmetry and, more critically, unbounded scores that depend on sample size, hindering reliable cross-scenario benchmarking. To address these challenges, we develop a unified topological toolkit serving two complementary needs: fine-grained structural diagnosis and robust, standardized evaluation. First, we complete the RTD framework by introducing Symmetric Representation Topology Divergence (SRTD) and its efficient variant SRTD-lite. Beyond resolving the theoretical asymmetry of prior variants, SRTD consolidates diagnostic information into a single, comprehensive cross-barcode signature. This allows for precise localization of structural discrepancies and serves as an effective optimization objective without the overhead of dual directional computations. Second, to enable reliable benchmarking across heterogeneous settings, we propose Normalized Topological Similarity (NTS). By measuring the rank correlation of hierarchical merge orders, NTS yields a scale-invariant metric bounded between -1 and 1, effectively overcoming the scale and sample-dependence of unnormalized divergences. Experiments across synthetic and real-world deep learning settings demonstrate that our toolkit captures functional shifts in CNNs missed by geometric measures and robustly maps LLM genealogy even under distance saturation, offering a rigorous, topology-aware perspective that complements measures like CKA.
Tsinghua AI