Yuxiao Wang

Papers on Lattice

Total citations

Topics

h-index

Research focus

Architecture Design (Transformers, SSMs, MoE) (1)Distributed Systems & Hardware (1)Training Efficiency & Optimization (1)

Frequent co-authors

Yuedong Xu (1)Qingyang Duan (1)Yuxuan Liu (1)Lei Jiao (1)

Papers (1)

Dec 24, 2025

Yuxiao Wang +6Dec 24, 2025

Diving into 3D Parallelism with Heterogeneous Spot Instance GPUs: Design and Implications

Training LLMs on heterogeneous GPUs just got a whole lot faster: AutoHet achieves up to 1.79x speedup over Megatron-LM and Whale by automatically optimizing the 3D parallelism strategy.

Yuxiao Wang, Yuedong Xu, Qingyang Duan +4

Architecture Design (Transformers, SSMs, MoE)Distributed Systems & Hardware Training Efficiency & Optimization

Search

Yuxiao Wang

Research focus

Frequent co-authors

Papers (1)