Elvis Dohmatob

Grokking's distinct phases—nuisance fitting, core learning, and delayed generalization—are analytically separable, with sharp conditions for occurrence and predictable plateau lengths.

LLM safety can be bypassed with optimal transport, revealing that refusal mechanisms are surprisingly localized within a few layers.