Search papers, labs, and topics across Lattice.
2
0
4
6
Muon's touted superiority in large-scale training may not hold up under controlled conditions, challenging its status as a go-to optimizer.
Merging experts in MoE LLMs can actually *improve* performance compared to pruning, offering a new path to compression that preserves capabilities.
