Search papers, labs, and topics across Lattice.
2
0
3
MONA unlocks faster LLM pretraining and superior downstream performance by turbocharging the Muon optimizer with Nesterov-style acceleration, leaving AdamW in the dust.
Training long-context sparse attention models doesn't have to be a slow, imbalanced mess: SparseBalance achieves 1.33x speedup while *improving* accuracy.
