Search papers, labs, and topics across Lattice.
Affiliation:
1
0
2
Linear attention's recurrent state can be compressed down to 4 bits while outperforming uniform INT8 once precision is dynamically allocated to long-lived memory tracks and output-sensitive key rows.