Junchi Yan

Papers on Lattice

Total citations

Topics

Publication activitypapers/week, last 8 weeks

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Scaling Laws & Emergent Abilities (1)Training Efficiency & Optimization (1)

Frequent co-authors

Ning Liao (1)Xiaoxing Wang (1)Xiaohan Qin (1)

Papers (1)

Mar 9, 2026

Ning Liao +31w ago

FineRMoE: Dimension Expansion for Finer-Grained Expert with Its Upcycling Approach

FineRMoE achieves 6x higher parameter efficiency, 281x lower prefill latency, and 136x higher decoding throughput compared to strong baselines, demonstrating a significant leap in MoE performance.

Ning Liao, Xiaoxing Wang, Xiaohan Qin +1

Architecture Design (Transformers, SSMs, MoE)Scaling Laws & Emergent Abilities Training Efficiency & Optimization

Search

Junchi Yan

Publication activitypapers/week, last 8 weeks

Research focus

Frequent co-authors

Papers (1)