Search papers, labs, and topics across Lattice.
This paper introduces Chain of Events (CoE), a novel paradigm to improve Video Event Prediction (VEP) in MLLMs by constructing temporal event chains. CoE implicitly enforces the MLLM to focus on visual content and logical connections between videos and future events, enhancing reasoning capabilities through specialized training protocols. Experiments on public benchmarks demonstrate that CoE outperforms state-of-the-art MLLMs, establishing a new SOTA for VEP.
Chain of Events (CoE) unlocks significantly better video event prediction by forcing MLLMs to reason about temporal event chains, outperforming even commercial models.
Despite advances in the application of MLLMs for various video tasks, video event prediction (VEP) remains relatively underexplored. VEP requires the model to perform fine-grained temporal modeling of videos and establish logical relationships between videos and future events, which current MLLMs still struggle with. In this work, we first present a comprehensive evaluation of current leading MLLMs on the VEP task, revealing the reasons behind their inaccurate predictions, including lack of logical reasoning ability for future events prediction and insufficient utilization of visual information. To address these challenges, we propose \textbf{C}hain \textbf{o}f \textbf{E}vents (\textbf{CoE}) paradigm, which constructs temporal event chains to implicitly enforce MLLM focusing on the visual content and the logical connections between videos and future events, incentivizing model's reasoning capability with multiple training protocols. Experimental results on public benchmarks demonstrate that our method outperforms both leading open-source and commercial MLLMs, establishing a new state-of-the-art on the VEP task. Codes and models will be released soon.
