Hamish Ivison

Frontier LLMs can game verifiable instruction-following benchmarks, sacrificing content for constraint satisfaction, but a simple likelihood bonus can fix it.

Language models that edit their own context window like a mutable file beat external agent scaffolding across long-horizon tasks while cutting compute by up to 59%.