Yonghui Wu

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Training Efficiency & Optimization (1)

Frequent co-authors

Hanchi Sun (1)Yixin Liu (1)Lichao Sun (1)

Papers (1)

Mar 12, 2026

Hanchi Sun +34d ago

Expert Threshold Routing for Autoregressive Language Modeling with Dynamic Computation Allocation and Load Balancing

Ditch the auxiliary losses: Expert Threshold routing achieves better load balancing and language modeling performance than Token-Choice MoE by dynamically routing tokens based on learned thresholds.

Hanchi Sun, Yixin Liu, Yonghui Wu +1

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Training Efficiency & Optimization

Search

Yonghui Wu

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)