Search papers, labs, and topics across Lattice.
Mila - Quebec AI Institute, Universite de Montreal
1
0
2
4
MoEs don't always need learned routers: routing information can be embedded directly in the hidden state.