Search papers, labs, and topics across Lattice.
3
0
6
11
Coding agents can achieve over 4x throughput gains with a novel retrieval-based speculative decoding framework that intelligently sources and formats reusable text and adapts draft lengths.
OasisKV achieves up to 2.1x throughput gains in LLM inference while using significantly less memory, challenging the limits of current HBM constraints.
ELDR slashes median latency by up to 13.9% for MoE models by intelligently routing requests based on expert activation signatures.
