Search papers, labs, and topics across Lattice.
1
0
Diagonal-adaptive optimizers unlock significantly higher gains from online data selection in LLM pretraining by preventing the discriminability collapse seen in other optimizers.