Search papers, labs, and topics across Lattice.
1
0
3
Speculative decoding can be sped up by >2x without sacrificing accuracy by rescuing previously rejected tokens that are semantically valid but lexically different.