Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
Investigating the limits of test-time compute scaling, the authors demonstrate that self-refinement in small reasoning models merely reallocates probability mass across already-reachable states rather than overcoming parametric knowledge bottlenecks. To resolve this, they build FlyBy, a framework where small models reason internally, diagnose epistemic limits, and execute selective, targeted queries to larger models only when an external knowledge bottleneck is detected. Across six challenging benchmarks, FlyBy-4B attains a 45.96% pass@8, surpassing the 2.7× more expensive monolithic Qwen3-14B (41.64%) while scaling to 51.81% with an 8B backbone.
Extra test-time "thinking" cannot recover missing parametric facts, but teaching small reasoning models to recognize their own knowledge boundaries and selectively query larger models lets a 4B model outperform a 14B baseline at nearly a third of the serving cost.
Scaling test-time computation is a powerful way to improve language-model reasoning, and is particularly appealing for small reasoning models (sRMs) that are cheap to serve. However, is additional thinking always the right operation? By intervening at intermediate reasoning states across two model families and multiple scales, we find that self-refinement largely consolidates probability mass onto solutions already reachable from the current state, rather than making new ones reachable. These interventions reveal two failure regimes: execution bottlenecks, where the correct path is reachable and reflection can recover it, and knowledge bottlenecks, where relevant external information makes it reachable. Motivated by this distinction, we introduce FlyBy, a selective querying framework, and train 4B and 8B variants to reason first, diagnose what remains unresolved, and, at a knowledge bottleneck, query stronger models whose parametric knowledge extends beyond its own. Supervised fine-tuning bootstraps a multi-depth query action, and cost-aware reinforcement learning calibrates whether to query, what to ask, and how much to spend. On 1,158 hard problems across six benchmarks, FlyBy-4B achieves 45.96% pass@8, surpassing Qwen3-14B (41.64%) at 2.7 times lower serving cost, while also exceeding Qwen3-8B in pass@1 (16.85% vs. 15.31%). Scaling to FlyBy-8B further improves pass@8 to 51.81%.