Search papers, labs, and topics across Lattice.
Xingyun Integrated Circuits Co
1
0
3
Local MoE inference can now match cloud-level performance, achieving 1,800 tokens/s on consumer GPUs while maintaining original model precision.