Search papers, labs, and topics across Lattice.
This paper introduces Dynamo, a training-free framework that enhances frozen vision-language models (VLMs) by evolving reusable reasoning skills and executable visual tools without weight updates. By leveraging a small labeled training subset, Dynamo allows agents to inspect their own performance and build a persistent library of capabilities, leading to significant improvements in visual reasoning tasks. The results show an average accuracy increase of 5.6% across various model-benchmark settings, effectively closing the performance gap with task-specific reinforcement learning approaches while requiring much less computational effort.
Dynamo achieves a remarkable 5.6% average accuracy boost in visual reasoning tasks without retraining, revolutionizing how VLMs adapt in real-time.
Improving vision-language models (VLMs) on visual reasoning typically requires retraining or hand-designed prompts and tools. We present Dynamo, a training-free framework that adapts a frozen VLM without any weight updates. On a small labeled training subset, the agent inspects its own correct and incorrect attempts and evolves two complementary capabilities: reusable reasoning skills for cognitive bottlenecks, and executable visual tools for perceptual ones. Each generated tool is paired with a skill that specifies when to invoke it, and both capability types accumulate in a persistent library. Across four visual reasoning benchmarks and five VLM backbones, Dynamo improves direct inference on all 20 model--benchmark settings (avg. +5.6 acc). When the tool set is given in advance, the framework learns when to call each tool, and per-step tool choice improves on every tested backbone. Against task-specific RL (VTool-R1, DeepEyes), Dynamo closes 65--99% of the RL gap at a fraction of the compute, and combines additively with RL when available.
DAMO