Search papers, labs, and topics across Lattice.
Beijing Tongming Lake Information Technology Application Innovation Center (TLAIC)
3
0
4
A single backward pass can fundamentally alter training outcomes based on how it reuses low-precision forward-pass tensors, defying standard accuracy checks.
Low-precision matrix multiplication, even when repaired for accuracy, can break LLM prefix invariance and alter downstream task performance, necessitating a new certification approach.
A single shared intervention in the query-key channel can stabilize low-precision transformer training, eliminating the need for individual fault repairs.