Search papers, labs, and topics across Lattice.
Affiliation:
1
0
3
Hierarchical MoE routing with a novel arrival-weighted mean estimation prevents expert collapse and enables localized co-activation, outperforming flat routing on large embedding models.