Search papers, labs, and topics across Lattice.
School of Electrical Engineering, KAIST, Daejeon, South Korea
4
0
5
0
Physical isolation in chiplet design can boost LLM serving performance by nearly 50% while slashing latency by over 60%.
LLMs can run over 2x faster on your phone without any extra training, thanks to a clever pruning and quantization strategy that doesn't sacrifice accuracy.
Diffusion models can run 4.7x faster and use 68% less energy thanks to a new sparsity-aware hardware accelerator that reuses cached tokens and attention sparsity patterns.
Video diffusion models can be accelerated by 4.5x with a novel hardware-software co-design that leverages output activations to guide token reduction, achieving significantly higher compression ratios than prior art.
