Search papers, labs, and topics across Lattice.
This paper introduces Qwen-Image-Agent, a novel framework designed to address the Context Gap in text-to-image (T2I) generation by integrating planning, reasoning, searching, memory, and feedback. By treating user input as partial context, the framework employs Context-Aware Planning to identify and acquire necessary context, while Context Grounding facilitates the collection of this information from various sources. Experimental results on the newly proposed Image Agent Bench (IA-Bench) and other benchmarks demonstrate that Qwen-Image-Agent significantly outperforms existing models, achieving state-of-the-art performance in real-world image generation tasks.
Bridging the Context Gap in T2I models, Qwen-Image-Agent achieves state-of-the-art performance by intelligently constructing context from user input and external sources.
While text-to-image (T2I) models have achieved remarkable progress, they struggle with real-world requests that are often underspecified, implicit, or dependent on up-to-date knowledge. We identify this challenge as the Context Gap: the mismatch between the user context and the sufficient generation context for T2I models. To bridge this gap, we propose Qwen-Image-Agent, a unified agentic framework that integrates plan, reason, search, memory and feedback in a context-centric manner. Qwen-Image-Agent treats user input as partial context and progressively constructs the generation context through Context-Aware Planning and Context Grounding. Specifically, Context-Aware Planning identifies missing context and plans how it should be acquired and used, while Context Grounding gathers this context from reason, search, memory, and feedback. To evaluate agentic image generation, we further introduce Image Agent Bench (IA-Bench), a benchmark covering four core image agent capabilities: Plan, Reason, Search, and Memory. Experiments on IA-Bench, Mindbench and WISE-Verified show that Qwen-Image-Agent outperforms strong baselines and achieves state-of-the-art performance.
Microsoft Research