Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
1
0
2
2
The goal of PrefixBench-H100 is to expose the practical operating envelope of prefix reuse for H100-class LLM serving, and identifies the regime where prefix reuse provides substantial first-token latency reductions and the regime where cache pressure erodes them.