Search papers, labs, and topics across Lattice.
Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University
3
0
4
0
Achieving up to 16x faster attention computation with only a 1.76% accuracy loss could revolutionize the deployment of long-context LLMs in real-time applications.
FlexServe achieves over 10X faster secure LLM inference on mobile devices without compromising privacy or performance.
On-device LLM inference can be sped up by an order of magnitude with a flexible TrustZone-based system that selectively protects memory and the NPU.
