Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Affiliation:
1
0
1
Routing decisions in sparse MoE models are governed by a shared geometric structure that enhances predictive accuracy across layers, challenging the notion of independence in expert selection.