Search papers, labs, and topics across Lattice.
Affiliation:
1
0
2
A novel bandit algorithm finds the optimal self-speculative decoding configuration for VLMs in real-time, boosting inference speed by up to 11% without retraining.
