Denis Kuznedelev

Aligning DLM generation with reference distributions via feature-space MMD significantly boosts performance on perplexity and reasoning tasks without retraining the entire model.

KV-cache offloading, a promising technique for long-context LLMs, can tank performance on tasks requiring heavy context extraction, but a surprisingly simple fix can restore accuracy.