Search papers, labs, and topics across Lattice.
2
1
4
2
Aggregate latency masks crucial insights into LLM inference efficiency, revealing that backend changes and quantization effects significantly influence performance metrics.
Intermediate context compression can cut GPU energy usage by over 50% while maintaining quality, challenging static compression strategies in edge RAG applications.
