Search papers, labs, and topics across Lattice.
University of Chinese Academy of Sciences
4
0
7
1
Speculative drafting can now dynamically query and integrate historical context from recurrent states, unlocking $3.16\times$ speedups on LLM generation.
Evaluated on recommendation models, Auto-RecSys significantly reduces the human time required per experiment cycle and improves execution reliability as its playbooks mature.
Newer LLMs may ace build tasks, but they struggle with delivering correct app behaviors, especially when specifications are involved.
Pre-attention spikes and inter-spike plateaus reveal a surprising organization in hybrid linear attention models that could redefine our understanding of activation dynamics in LLMs.