Search papers, labs, and topics across Lattice.
Renmin University of China
2
0
4
Aligning router rows with principal singular directions significantly boosts the effectiveness of Mixture-of-Experts models, challenging existing design principles.
Filtering out high-frequency tokens from LLM embeddings can significantly enhance their semantic quality and downstream performance.
