Search papers, labs, and topics across Lattice.
3
0
6
1
Speculative decoding can achieve up to 6.6x speedup by parallelizing token verification and recovering intra-block dependencies with a lightweight contextual corrector.
SwitchSD is introduced, an adaptive framework that treats copying as a latent control signal of the LLM that allows the system to dynamically switch between neural drafting and context-based copying, effectively turning copying from a noisy heuristic into a principled, model-aware decoding regime.
LLM-generated explanations often mislead, but a simple attention-guidance "serum" can make them significantly more faithful to the model's actual reasoning.
