Search papers, labs, and topics across Lattice.
This study addresses the challenge of superposition in neural networks, which complicates the interpretability of high-dimensional biological data. By employing sparse autoencoders (SAEs) on a dataset of over 100,000 images from Parkinson's disease and healthy neurons, the authors successfully resolve superposition and recover geometric fidelity in latent spaces. The resulting interpretable representations enable the alignment of image data with single-cell RNA sequencing methodologies, facilitating the reconstruction of neuronal pathology pathways without relying on spatial transcriptomics.
Superposition in neural networks can obscure biological insights, but this study reveals how sparse autoencoders can restore geometric fidelity and enhance interpretability in high-dimensional data.
Artificial intelligence is transforming our capability to solve biological challenges. In dimensionality bottleneck regimes exacerbated by high-dimensional biological data, Neural networks force distinct concepts into the lower dimensions known as superposition. Although this superposition is widely known to hinder interpretability, its impact on corrupting the geometry of latent spaces remains critically overlooked. Here, we utilized sparse autoencoders (SAEs) trained on over 100,000 multiplexed images of patient-derived Parkinson's disease and healthy neurons to resolve superposition. This approach bypasses the mathematical non-uniqueness of feature attribution by shifting to interpretable latent representation analysis. We theoretically and empirically demonstrate that superposition contaminates representational metric spaces, and thereby SAEs successfully recover geometric fidelity. By treating these geometrically purified representations as single-cell state vectors, we adapted single-cell RNA sequencing (scRNA-seq) data analysis methodologies directly to the image domain. Finally, we introduce GW-map, utilizing Gromov-Wasserstein optimal transport to align these image representations with authentic scRNA-seq data \emph{de novo}. This coupling reconstructs hierarchical neuronal pathology pathways such as Calcium-AIS scaffold, without reference spatial transcriptomics, establishing a scalable foundation for spatial biology. Code is available at https://github.com/jijihihi/Bio_superposition