Mingfu Liang

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Inference & Quantization (1)

Frequent co-authors

Zijie Liu (1)Jie Peng (1)Jinhao Duan (1)Zirui Liu (1)

Papers (1)

Feb 23, 2026

2w ago

A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs

Solve SMoE load balancing at inference time without retraining by replicating heavily used experts and quantizing underutilized ones, achieving up to 1.4x imbalance reduction.

Zijie Liu, Jie Peng, Jinhao Duan +6

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Inference & Quantization

Search

Mingfu Liang

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)