Search papers, labs, and topics across Lattice.
Affiliation:
1
0
0
Standard BF16 FlashAttention silently breaks a fundamental zero-sum symmetry in the softmax backward pass, corrupting query gradients by over 200% and triggering thousandfold gradient blowups late in pretraining.
