Search papers, labs, and topics across Lattice.
Astronautics WeChat AI, Tencent ▲, Nanjing University of Aeronautics, Fudan University Independent Researcher
4
0
6
Threshold-sensitive KV cache pruning is out; ReFreeKV's adaptive approach achieves robust memory efficiency without predefined limits.
SARA unlocks the potential of low-resource languages in multilingual models by aligning their expert routing with high-resource anchors, leading to measurable performance gains.
LLMs struggle with statistical analysis, achieving only 68.6% accuracy on a new benchmark designed to rigorously test their capabilities.
Multilingual MoEs can achieve best-in-class performance-to-compute ratios, even with extreme sparsity, by strategically upcycling from dense models and exhibiting structured expert activation patterns across languages.
