Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Yuedong Xu is with College of Computer Science and Artificial Intelligence, and Artificial Intelligence Innovation and Incubation Institute, Fudan University, Shanghai, China (e-mail: ydxu@fudan.edu.cn)
1
0
3
0
Training LLMs on heterogeneous GPUs just got a whole lot faster: AutoHet achieves up to 1.79x speedup over Megatron-LM and Whale by automatically optimizing the 3D parallelism strategy.