Search papers, labs, and topics across Lattice.
Affiliation:
1
0
2
Native 8-bit LLM training silently destabilizes at billion-parameter scale due to softmax gradient drift, but restoring the zero-row-sum invariant completely eliminates the FP8 attention gap without architecture modifications.
