Search papers, labs, and topics across Lattice.
1
0
2
3
Relaxed speculative decoding can significantly boost sampling speed, but it comes with hidden costs in capability evaluation and model quality.