Search papers, labs, and topics across Lattice.
The paper investigates the relationship between distributional similarity and representational similarity in discriminative models, focusing on autoregressive language models. It demonstrates that closeness in a novel "logit distance" metric, unlike KL divergence, guarantees linear representational similarity between models. The authors prove a bound on representational dissimilarity based on the models' identifiability class, showing it's directly controlled by the logit distance, and empirically validate that logit-distance distillation preserves linear representational properties better than KL-based distillation.
KL divergence can fool you: matching a teacher's predictions doesn't guarantee preserving its internal representations, but distilling with logit distance does.
For a broad family of discriminative models that includes autoregressive language models, identifiability results imply that if two models induce the same conditional distributions, then their internal representations agree up to an invertible linear transformation. We ask whether an analogous conclusion holds approximately when the distributions are close instead of equal. Building on the observation of Nielsen et al. (2025) that closeness in KL divergence need not imply high linear representational similarity, we study a distributional distance based on logit differences and show that closeness in this distance does yield linear similarity guarantees. Specifically, we define a representational dissimilarity measure based on the models' identifiability class and prove that it is bounded by the logit distance. We further show that, when model probabilities are bounded away from zero, KL divergence upper-bounds logit distance; yet the resulting bound fails to provide nontrivial control in practice. As a consequence, KL-based distillation can match a teacher's predictions while failing to preserve linear representational properties, such as linear-probe recoverability of human-interpretable concepts. In distillation experiments on synthetic and image datasets, logit-distance distillation yields students with higher linear representational similarity and better preservation of the teacher's linearly recoverable concepts.
