Search papers, labs, and topics across Lattice.
Email:, Harbin Institute of Technology (Shenzhen)
2
0
5
15
A single inference engine now unifies 15 sparse attention methods, unlocking over 10x throughput gains for long-context LLMs through intelligent KV cache management.
MLLMs do not need full-depth forward passes on every incoming frame: indexing video streams solely within early transformer layers slashes prefill latency by 52x without degrading downstream comprehension.