Fred Zhangzhi Peng

Duke University

Papers on Lattice

Total citations

Topics

h-index

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Training Efficiency & Optimization (1)

Frequent co-authors

Shuibai Zhang (1)Caspian Zhuang (1)Chihan Cui (1)Zhihan Yang (1)

Papers (1)

Apr 2, 2026

Introduction Figure 1: Training loss vs. wall-clock time. EC reaches loss 3.75 in 10.6h3w ago·also Cornell, Duke, Scitix, UC Davis

Expert-Choice Routing Enables Adaptive Computation in Diffusion Language Models

Diffusion language models can achieve faster convergence and improved accuracy simply by swapping token-choice routing for expert-choice routing, and further benefit from allocating more compute to early denoising steps.

Shuibai Zhang, Caspian Zhuang, Chihan Cui +8

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Training Efficiency & Optimization

Search

Fred Zhangzhi Peng

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)