Search papers, labs, and topics across Lattice.
The paper introduces the "2-datapoint reduced density matrix" (2RDM) as a tool for analyzing phase transitions during deep learning model training. By tracking the eigenvalue statistics of the 2RDM, the authors derive the spectral heat capacity and participation ratio, which act as early warning signals for second-order phase transitions and reveal the dimensionality of the reorganization, respectively. The method's interpretability is highlighted through validation across deep linear networks, induction head formation, grokking, and emergent misalignment.
Quantum chemistry's density matrix approach reveals interpretable early warning signals of phase transitions in deep learning, from grokking to emergent misalignment.
A key problem in the modern study of AI is predicting and understanding emergent capabilities in models during training. Inspired by methods for studying reactions in quantum chemistry, we present the ``2-datapoint reduced density matrix". We show that this object provides a computationally efficient, unified observable of phase transitions during training. By tracking the eigenvalue statistics of the 2RDM over a sliding window, we derive two complementary signals: the spectral heat capacity, which we prove provides early warning of second-order phase transitions via critical slowing down, and the participation ratio, which reveals the dimensionality of the underlying reorganization. Remarkably, the top eigenvectors of the 2RDM are directly interpretable making it straightforward to study the nature of the transitions. We validate across four settings distinct settings: deep linear networks, induction head formation, grokking, and emergent misalignment. We then discuss directions for future work using the 2RDM.
