Search papers, labs, and topics across Lattice.
Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University
3
0
5
1
Achieving up to 16x faster attention computation with only a 1.76% accuracy loss could revolutionize the deployment of long-context LLMs in real-time applications.
FlexServe achieves over 10X faster secure LLM inference on mobile devices without compromising privacy or performance.
Edge NPUs can outperform flagship GPUs in cost and energy efficiency for on-robot VLA model deployment, but only with hardware-aware optimizations that tackle the models' distinct compute and memory-bound phases.
