Search papers, labs, and topics across Lattice.
This paper introduces RIG-BENCH, a systematic benchmark designed to evaluate Reasoning-driven Image Generation (RIG) across four challenging domains, highlighting the limitations of current unified generative models (UGMs) in high-level visual reasoning. The authors conducted extensive evaluations on state-of-the-art models, revealing a significant reasoning-generation gap where outputs may appear plausible locally but fail to maintain global logical consistency. By providing 2000 curated samples, RIG-BENCH serves as a critical diagnostic tool to advance the development of UGMs that can achieve true visual generative intelligence through reasoning.
A significant reasoning-generation gap exposes the limitations of current generative models, revealing that they often produce outputs that are locally plausible yet globally illogical.
Recent advancements in unified generative models (UGMs) and world simulators have achieved unprecedented results in visual perception and synthesis. However, these models primarily rely on surface-level event alignment, leaving the capacity for high-level visual reasoning underexplored. True visual generative intelligence demands "Reasoning-to-Generation", an ability to infer latent rules from visual inputs and manifest solutions through precise, logically constrained visual outcomes. We introduce RIG-BENCH, a novel comprehensive benchmark that systematically evaluates Reasoning-driven Image Generation (RIG) across four cognitively demanding domains: Concept-based, Transformation-based, Pattern & Structure, and Scenario-based. Featuring 2000 curated samples, RIG-BENCH serves as a rigorous stress test for RIG. Our extensive evaluations of state-of-the-art UGMs and image/video generation models reveal a significant reasoning-generation gap, wherein models frequently produce locally plausible but globally illogical outputs. RIG-BENCH provides a vital diagnostic framework to guide the development of next-generation, logically grounded UGMs and world simulators.