Search papers, labs, and topics across Lattice.
Beijing Information Science and Technology University The work was done while the author interned at Zhipu.AI.
1
0
3
RotMoLE's rotational gating unlocks more representational power from low-rank MoE architectures, even when expert diversity is limited.