Search papers, labs, and topics across Lattice.
This paper analyzes quantization error in linear layers of neural networks through the lens of signal-to-quantization-noise ratio (SQNR), decomposing it into weight/activation concentration and alignment. It reveals that improving the alignment of dominant variation directions between weights and activations can further reduce quantization error beyond just improving concentration. The authors introduce block Concentration-Alignment Transforms (CAT), a lightweight linear transformation that jointly improves concentration and alignment, achieving state-of-the-art 4-bit quantization results across several LLMs.
Quantization error isn't just about concentrating weights, it's also about aligning them with activations, and a simple transform can exploit this to boost 4-bit LLM performance.
Quantization can drastically increase the efficiency of large language and vision models, but typically incurs an accuracy drop. Recently, function-preserving transforms (e.g. rotations, Hadamard transform, channel-wise scaling) have been successfully applied to reduce post-training quantization error, yet a principled explanation remains elusive. We analyze linear-layer quantization via the signal-to-quantization-noise ratio (SQNR), showing that for uniform integer quantization at a fixed bit width, SQNR decomposes into (i) the concentration of weights and activations (capturing spread and outliers), and (ii) the alignment of their dominant variation directions. This reveals an actionable insight: beyond concentration - the focus of most prior transforms (e.g. rotations or Hadamard) - improving alignment between weight and activation can further reduce quantization error. Motivated by this, we introduce block Concentration-Alignment Transforms (CAT), a lightweight linear transformation that uses a covariance estimate from a small calibration set to jointly improve concentration and alignment, approximately maximizing SQNR. Experiments across several LLMs show that CAT consistently matches or outperforms prior transform-based quantization methods at 4-bit precision, confirming the insights gained in our framework.
