Search papers, labs, and topics across Lattice.
Affiliation:
2
0
7
Scale vectors, despite being a tiny fraction of LLM parameters, are critical for pre-training, and this paper unlocks how to make them even better with simple, theoretically-grounded tweaks.
