Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to test-time compute by emphasizing interaction scaling, where a model iteratively proposes artifacts, receives feedback from an external observer, and revises its outputs. Unlike traditional methods that rely solely on reasoning or sampling, this interaction-based method allows the model to incorporate real observations, effectively breaking through the limitations of internal feedback mechanisms. The results demonstrate that interaction strategies significantly outperform reasoning-only and best-of-N sampling methods, achieving a perfect pass rate on coding tasks and substantially reducing defects in visual artifacts across multiple modalities.
Interaction scaling reveals a powerful new dimension of model performance that consistently outperforms traditional reasoning and sampling methods by leveraging real-time feedback.
There are two standard ways to spend more compute at test time: let a model reason longer, or sample more attempts and keep one. Both share a hidden limit: they are internal. Every extra token comes from the same frozen weights and the same prompt, so neither can tell the model anything it does not already know. We study a third way, interaction: the model proposes an artifact, an external instrument observes how it actually behaves, and the model revises. Each cycle imports a real observation, so interaction breaks through the ceiling the other two hit. We argue that a single variable governs this third axis, grounding, and that it must hold on both sides of the loop. The feedback that drives revision must come from an instrument that actually observes the flaw, and so must the metric that scores the result. On hard coding tasks at a fixed token budget, reasoning-only and best-of-N sampling both plateau (the latter even when an oracle picks the best sample), while every interaction strategy keeps improving; our proposer-reviewer harness reaches a perfect 100% pass rate with no run-to-run variance, and the gain holds across three model families. On rendered visual artifacts, the usual judge (a vision-language model, or VLM, reading a screenshot) rates 14 of 15 visibly broken figures "perfect," because the screenshot hides the flaws before the judge can see them. A tool that measures the real layout instead shows the loop removing 40-74% of defects across four modalities; and that same VLM, used as the reviewer, makes slide layouts worse where the measuring tool repairs them. Interaction scaling is real and distinct from reasoning and sampling, but only visible when both the feedback and the metric are grounded.
UW