Hao Gu

Across reasoning, long-context understanding, and agentic tasks, SAS consistently outperforms trainable sparse attention baselines across attention budgets, with especially large gains under tight budgets, demonstrating more effective context ranking for downstream tasks.

Coordinating cache compression with a process reward can slash token generation by up to 65% without sacrificing accuracy.