Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the impact of model handoffs on the performance of coding agents during long-running tasks, focusing on the trade-offs between cost and quality when switching between low-cost (LC) and high-cost (HC) models. The authors introduce the concept of the "handoff tax," which quantifies the quality loss incurred when transitioning from LC to HC models, revealing that full-trajectory escalation only recovers less than half of the quality gap while significantly increasing costs. In contrast, the study finds that downshifting to a lower-capability model can yield a more favorable cost-quality balance, with the effectiveness of trajectory information varying based on the direction of the handoff.
Switching between models incurs a "handoff tax" that can significantly degrade quality while increasing costs, challenging the assumption that stronger models always yield better outcomes.
Coding agents perform long-running tasks spanning dozens of model calls, tool uses, and code edits. As these runs unfold, users face a practical cost-quality trade-off: escalating to a stronger model when a cheaper one struggles, or downshifting once the hard reasoning is complete. Each switch requires the receiver to continue a non-native trajectory produced by another model. We study how this handoff affects quality and cost, and how varying the trajectory information inherited by the receiver changes the outcome. Using pairs of low-cost, low-capability (LC) and high-cost, high-capability (HC) models from the Claude and GPT families, we vary handoff direction, timing, and interface, comparing full-trajectory transfer, compaction, and trajectory removal while preserving the repository state. Across both model families, full-trajectory escalation recovers less than half of the LC-to-HC quality gap while incurring a substantial cost premium. We term this cost-quality penalty the handoff tax. By contrast, downshift offers a favorable cost-quality point. Interestingly, the preferred interface also reverses with direction: reducing LC-model trajectory information improves escalation quality, whereas removing the HC-model trajectory reduces downshift quality.
Amazon Science