Ashkan Shahbazi

LLM inference cost plummets as a novel output-aware KV cache retrieval method bypasses attention score approximation errors, achieving competitive performance with minimal overhead.

Dataset distillation's dirty secret: soft labels bloat storage, but a VQ-VAE slashes their size by 30-40x without sacrificing performance.