Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
Affiliation:
2
0
4
Speculative decoding drafters can achieve over 2x speedup on 256K context by treating distant tokens as shared far memory with sharpened attention.
Text-to-image synthesis just got almost 4x faster without sacrificing image quality, thanks to a clever twist on Speculative Jacobi Decoding that keeps the generation process moving even when initial drafts are rejected.