Search papers, labs, and topics across Lattice.
1
0
3
EcoSpec reveals that optimizing for expert activation costs can lead to faster decoding in large-scale MoE models, achieving significant speedups without sacrificing model performance.
