Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Affiliation:
2
0
5
0
Query-independent eviction signals can maintain 100% retrieval accuracy in KV caches while compressing data without any measurable cost.
Reordering attention and feed-forward operations in LLMs can significantly enhance computational efficiency without sacrificing performance.