Yonghui Wu

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Training Efficiency & Optimization (1)

Frequent co-authors

Hanchi Sun (1)Yixin Liu (1)Lichao Sun (1)

Papers (1)

Mar 12, 2026

Hanchi Sun +3Mar 12, 2026

Expert Threshold Routing for Autoregressive Language Modeling with Dynamic Computation Allocation and Load Balancing

Forget auxiliary losses and fixed expert capacity: Expert Threshold routing dynamically allocates computation in MoEs and balances expert load, all while boosting data efficiency by 1.6x.

Hanchi Sun, Yixin Liu, Yonghui Wu +1

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Training Efficiency & Optimization

Search

Yonghui Wu

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)