Search papers, labs, and topics across Lattice.
Department of Artificial Intelligence, Hanyang University, Seoul, Republic of Korea
1
0
3
LENS achieves an impressive 2.15% mean prediction error in latency estimation for LLM inference on NPUs, even without access to microarchitecture details.