Search papers, labs, and topics across Lattice.
Shanghai Jiao Tong University
1
0
2
Agentic AI inference can be accelerated by 2-6x with history-free speculative decoding that eliminates KV cache overhead and boosts acceptance rates by up to 70%.