Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Through an operator-level mechanistic and checkpoint analysis, this work investigates the survival mechanism behind massive activation features (MAs) that persist across Transformer residual streams. The authors discover a pervasive "read-blindness" in both attention and feed-forward layers, which systematically ignore MA coordinates when reading from the residual stream while continuing to write to them, breaking the negative feedback loops necessary for suppression. This read-write asymmetry emerges upstream of FFN amplification during pretraining and is actively maintained by asymmetries in the loss landscape, causing models to exhibit compensatory shifts when read-blindness is locally suppressed.
Transformers actively protect their massive activation outliers through an upstream "read-blindness," where layers continually write to extreme residual coordinates while systematically refusing to read them.
Massive activation features (MAs) in Transformers are extreme-value residual-stream features that persist across layers despite the model's ability to suppress them. Why do they survive? Our investigation using an operator-level mechanistic analysis of attention and feed-forward (FFN) blocks reveals that these blocks systematically ignore MA coordinates while reading, but not while writing; creating a read-write asymmetry that blocks corrective feedback while allowing continued accumulation. We find that both attention and feed-forward layers have this read-blindness, and contribute to the emergence and persistence of MAs. To validate prior work that hypothesized that FFN's amplification abilities is the primary reason for MAs (Sun et al., 2026), we analyze the model checkpoints during learning. Contrary to our expectation, read-blindness emerges before FFN amplification, suggesting that it acts upstream in the MA mechanism. We further contribute gradient analysis to link this behavior to surprising asymmetries in the loss landscape, concluding that the model actively maintains this read-blindness. Finally, we find that removing read-blocking at different locations induces compensatory shifts elsewhere, but MAs still persist.