Search papers, labs, and topics across Lattice.
This paper introduces ImageTime, a novel benchmark designed to evaluate image generation models on their ability to maintain spatiotemporal consistency across multiple visual states. By requiring models to generate a sequence of four key images representing an initial state, action onset, transition, and final state, the benchmark assesses how well these models can imagine and represent temporal processes. The findings indicate significant gaps in current models' capabilities to coherently depict visual changes over time, highlighting areas for improvement in visual world modeling.
Current image generation models struggle to maintain coherent visual narratives over time, revealing critical limitations in their temporal reasoning abilities.
Image generation models now produce high-quality static images, yet their ability to represent how a visual world changes over time remains poorly understood. Practical workflows such as storyboarding, step-by-step illustration, reference-guided editing, and video previsualization require models to preserve identities, objects, spatial relations, and causal order across multiple visual states. Existing evaluations largely measure single-image correctness, compositional alignment, or video quality, leaving open whether an image model can coherently imagine a temporally ordered process. We introduce ImageTime, a diagnostic benchmark that uses spatiotemporal consistency as a behavioral probe of visual world modeling in image generation. Given an action instruction, and optionally a reference image specifying the initial state, a model must generate one image containing four ordered key states: initial state, action onset, transition state, and final state. This four-keyframe protocol is more temporally demanding than single-image generation while avoiding the confounds of dense video dynamics. ImageTime organizes tasks with a progressive capability hierarchy and decomposes each scenario into stage-wise state predicates, cross-frame temporal constraints, and forbidden causal violations. GPT-5.5 scores all generated images under a structured VLM-as-judge protocol, producing interpretable capability scores, diagnostic subscores, and failure labels. Through multi-family benchmarking, ImageTime reveals where current image generation systems succeed, fail, and drift when asked to maintain coherent visual world states over time.
