Search papers, labs, and topics across Lattice.
1
0
2
Forget training a complex layer-skipping policy – ConfLayers achieves similar speedups in self-speculative decoding by simply dropping layers based on confidence scores.