Search papers, labs, and topics across Lattice.
Institute of Foundation Models
2
0
2
Key contribution not extracted.
Standard BF16 FlashAttention silently breaks a fundamental zero-sum symmetry in the softmax backward pass, corrupting query gradients by over 200% and triggering thousandfold gradient blowups late in pretraining.
