Search papers, labs, and topics across Lattice.
Xi’an UniIC Semiconductors
1
0
3
0
A hybrid-bonding-based LLM serving accelerator, Helios, tackles the dynamic nature of KV cache management in LLM serving, achieving significant speedup and energy efficiency gains over existing GPU/NMP designs.
