Search papers, labs, and topics across Lattice.
Columbia University, University of Pennsylvania
1
0
3
Black-box MIPS oracles can approximate attention with $O(1/\varepsilon^2)$ keys by augmenting queries and keys, bypassing $\sqrt{n}$ and $\log n$ dependencies.