Search papers, labs, and topics across Lattice.
This paper introduces a benchmark for evaluating chronological reasoning in Vision-Language Models (VLMs), addressing a significant gap in their ability to interpret temporal information. The authors construct three specialized datasets to assess how VLMs reason about chronological events and whether they rely on superficial cues rather than genuine chronological features. Results indicate that while VLMs demonstrate some capability, they often exploit incorrect shortcuts, highlighting the need for improved models that engage in authentic chronological reasoning.
VLMs often rely on misleading visual cues instead of true chronological understanding, revealing critical flaws in their reasoning capabilities.
Recent advancements in Vision-Language Models (VLMs) have significantly enhanced their ability to interpret complex visual semantics, yet their capacity for chronological reasoning remains under-explored. In this paper, we introduce a novel benchmark specifically designed to evaluate how VLMs perceive and reason about chronological information within and across images. Unlike existing video-based benchmarks that focus on frame sequencing, our work delves into the underlying logic of chronological judgment and the expansion toward multimodal integration. To facilitate this, we construct three specialized datasets: one containing visually similar objects spanning long historical durations, another categorized by diverse event and object types, and a third pairing images with time-sensitive news text for cross-modal alignment. Through extensive experiments, we analyze whether models exhibit performance disparities across categories and, crucially, explore whether they rely on ``incorrect shortcuts'', such as image color rather than genuine chronological features. Our results reveal that while VLMs show promise, they frequently exploit superficial cues like grayscale versus color filters to bypass authentic chronological reasoning. By providing these high-quality datasets and a rigorous evaluation framework, we offer a diagnostic tool to identify current limitations and guide the development of more robust, logically grounded multimodal models. The source code is shown in https://github.com/LuoRenqiang/ChronoVision.
