Bingchen Yao

Linear attention's recurrent state can be compressed down to 4 bits while outperforming uniform INT8 once precision is dynamically allocated to long-lived memory tracks and output-sensitive key rows.

Outlier-aware rotation can halve the rotation cost in quantization while maintaining state-of-the-art performance in LLMs.