Search papers, labs, and topics across Lattice.
This survey paper provides a structured overview of video understanding research, organizing the literature into three perspectives: low-level geometry, high-level semantics, and unified models. It highlights the shift from task-specific pipelines towards unified modeling paradigms for diverse downstream objectives. The paper consolidates these perspectives to provide a coherent map of the video understanding landscape, summarizing key trends and outlining open challenges for building robust and scalable video foundation models.
The field of video understanding is rapidly shifting from isolated pipelines to unified models capable of adapting to diverse downstream tasks, demanding a re-evaluation of current approaches.
Video understanding aims to enable models to perceive, reason about, and interact with the dynamic visual world. In contrast to image understanding, video understanding inherently requires modeling temporal dynamics and evolving visual context, placing stronger demands on spatiotemporal reasoning and making it a foundational problem in computer vision. In this survey, we present a structured overview of video understanding by organizing the literature into three complementary perspectives: low-level video geometry understanding, high-level semantic understanding, and unified video understanding models. We further highlight a broader shift from isolated, task-specific pipelines toward unified modeling paradigms that can be adapted to diverse downstream objectives, enabling a more systematic view of recent progress. By consolidating these perspectives, this survey provides a coherent map of the evolving video understanding landscape, summarizes key modeling trends and design principles, and outlines open challenges toward building robust, scalable, and unified video foundation models.
