Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper proposes a five-level taxonomy for visual generation models, ranging from simple "Atomic Generation" to more sophisticated "World-Modeling Generation," to highlight the field's evolution beyond appearance synthesis. It identifies key technical drivers like flow matching and improved visual representations, while also critiquing current evaluation metrics for overemphasizing perceptual quality at the expense of structural and causal understanding. The authors advocate for a shift toward intelligent visual generation capable of spatial reasoning, persistent state management, and causal understanding.
Today's visual generation models are often evaluated on the wrong things, leading to inflated performance claims that mask critical failures in spatial reasoning, temporal consistency, and causal understanding.
Recent visual generation models have made major progress in photorealism, typography, instruction following, and interactive editing, yet they still struggle with spatial reasoning, persistent state, long-horizon consistency, and causal understanding. We argue that the field should move beyond appearance synthesis toward intelligent visual generation: plausible visuals grounded in structure, dynamics, domain knowledge, and causal relations. To frame this shift, we introduce a five-level taxonomy: Atomic Generation, Conditional Generation, In-Context Generation, Agentic Generation, and World-Modeling Generation, progressing from passive renderers to interactive, agentic, world-aware generators. We analyze key technical drivers, including flow matching, unified understanding-and-generation models, improved visual representations, post-training, reward modeling, data curation, synthetic data distillation, and sampling acceleration. We further show that current evaluations often overestimate progress by emphasizing perceptual quality while missing structural, temporal, and causal failures. By combining benchmark review, in-the-wild stress tests, and expert-constrained case studies, this roadmap offers a capability-centered lens for understanding, evaluating, and advancing the next generation of intelligent visual generation systems.
DAMO