Search papers, labs, and topics across Lattice.
Tsinghua University, Beijing National Research Center for Information Science and Technology
Tsinghua AI1
0
3
Local MoE inference can now match cloud-level performance, achieving 1,800 tokens/s on consumer GPUs while maintaining original model precision.
