Search papers, labs, and topics across Lattice.
1
0
2
SoftMoE achieves comparable or superior performance to traditional sparse MoE while activating significantly fewer experts, revolutionizing expert allocation in LLMs.
