Search papers, labs, and topics across Lattice.
Mohamed, Zayed University of Artificial Intelligence (MBZUAI)
1
0
2
Interleaving expensive Muon spectral steps with cheap Lion sign descent not only cuts distributed training wall-clock time by 33%, but actually beats full Muon and AdamW on final perplexity.