Search papers, labs, and topics across Lattice.
This paper investigates the relationship between attention sinks and massive activations in Transformers, focusing on the backpropagation process. It demonstrates that attention sinks, particularly under causal masking, induce concentrated gradients termed "gradient sinks." The authors further show that massive activations in pre-norm RMSNorm architectures are an adaptive response to these localized gradient pressures during training, validated by a novel V-scale modification that adjusts value-path gradients.
Attention sinks aren't just a forward-pass phenomenon; they actively warp the training landscape by creating "gradient sinks" that drive massive activations.
Attention sinks and massive activations are recurring and closely related phenomena in Transformer models. Existing studies have largely focused on the forward pass, making it unclear whether their connection is direct or mediated by a training-time mechanism. We study this question from the perspective of backpropagation. Empirically and theoretically, we show that under causal mask, attention sinks can induce pronounced gradient concentration, which we term gradient sinks. Furthermore, in pre-norm architectures with RMSNorm, massive activations can be understood as an adaptive response to this localized gradient pressure during training. To test this hypothesis, we introduce V-scale, a modification that adjusts value-path backpropagated gradients. In pretrained V-scale models, attention sinks are preserved whereas massive activations are suppressed. These results support the interpretation that gradient sink is a key training-time mediator linking attention sinks and massive activations.
