Search papers, labs, and topics across Lattice.
Affiliation:
1
0
3
The optimal vocabulary size for LLMs can shift dramatically based on serving conditions, with potential divergences from training norms by up to 16x.