Search papers, labs, and topics across Lattice.
2
0
4
3
Learned scaling matrices can dramatically enhance LLM compression efficiency, achieving lower effective rank and better performance than traditional methods.
Replacing softmax with a calibrated clipped-linear approximation can dramatically speed up Transformer inference on edge devices without sacrificing accuracy.