Search papers, labs, and topics across Lattice.
The paper introduces RL-RIG, a reinforcement learning framework designed to improve spatial reasoning in image generation by iteratively generating, reflecting on, and editing images. It addresses the limitation of current image generation models in capturing fine-grained spatial relationships. The framework uses a Diffuser, Checker, Actor, and Inverse Diffuser, trained with Reflection-GRPO, and achieves up to 11% improvement over state-of-the-art models in spatial accuracy, as measured by Scene Graph IoU and VLM-as-a-Judge metrics on the LAION-SG dataset.
Image generation models can now reason about spatial relationships with significantly improved accuracy thanks to a novel reinforcement learning framework that iteratively refines images based on spatial consistency checks.
Recent advancements in image generation have achieved impressive results in producing high-quality images. However, existing image generation models still generally struggle with a spatial reasoning dilemma, lacking the ability to accurately capture fine-grained spatial relationships from the prompt and correctly generate scenes with structural integrity. To mitigate this dilemma, we propose RL-RIG, a Reinforcement Learning framework for Reflection-based Image Generation. Our architecture comprises four primary components: Diffuser, Checker, Actor, and Inverse Diffuser, following a Generate-Reflect-Edit paradigm to spark the Chain of Thought reasoning ability in image generation for addressing the dilemma. To equip the model with better intuition over generation trajectories, we further develop Reflection-GRPO to train the VLM Actor for edit prompts and the Image Editor for better image quality under a given prompt, respectively. Unlike traditional approaches that solely produce visually stunning yet structurally unreasonable content, our evaluation metrics prioritize spatial accuracy, utilizing Scene Graph IoU and employing a VLM-as-a-Judge strategy to assess the spatial consistency of generated images on LAION-SG dataset. Experimental results show that RL-RIG outperforms existing state-of-the-art open-source models by up to 11% in terms of controllable and precise spatial reasoning in image generation.
Tsinghua AI