Search papers, labs, and topics across Lattice.
Affiliation:
1
0
3
Black-box MIPS oracles can approximate attention with $O(1/\varepsilon^2)$ keys by augmenting queries and keys, bypassing $\sqrt{n}$ and $\log n$ dependencies.