Search papers, labs, and topics across Lattice.
CMU ML
Stanford HAIDepartments of Computer Science and PsychologyWu Tsai Neurosciences InstituteJul 9, 2026arXiv:2607.08561This paper establishes a formal framework for understanding the alignment of deep neural networks (DNNs) with biological brain networks through the lens of contravariance theory. It reveals that weak alignment of network representations can lead to strong alignment of privileged axes, and that this alignment process propagates hierarchically through the network. The findings suggest that with challenging tasks, the choice of metric for comparing networks is less critical, indicating a likely inevitability of convergent evolution in DNNs and biological systems.
Weak alignment in DNNs can lead to strong alignment of privileged axes, suggesting a surprising robustness in inter-network comparisons.
A series of results from the NeuroAI over the past fifteen years have raised core questions both about how to compare Deep Neural Network (DNN) models to the brain, and about how much convergent evolution to expect between artificial networks and real brain networks. Here, we show that for any two minimal DNN solutions to a sufficiently hard task: (i)"weak"alignment of network representations based on affine mappings guarantees"strong"alignment of privileged axes, and (ii) alignment"zippers"up the network hierarchy, causing the emergence of privileged axes from end-to-end task optimization. These results formalize the notion of contravariance from Cao and Yamins [2024], and illustrate important consequences for the theory of NeuroAI: with sufficiently strong tasks, choice of metric for inter-network comparison is not all that sensitive, and that convergent evolution is probably inevitable.
