Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
2
0
3
3
Speculative drafting can now dynamically query and integrate historical context from recurrent states, unlocking $3.16\times$ speedups on LLM generation.
Pre-attention spikes and inter-spike plateaus reveal a surprising organization in hybrid linear attention models that could redefine our understanding of activation dynamics in LLMs.