Search papers, labs, and topics across Lattice.
This paper introduces VideoRover, a unified framework that integrates active video reasoning with deep research capabilities to enhance open-world video understanding. By coordinating video cropping, multimodal search, and webpage browsing, VideoRover enables models to iteratively refine their understanding based on both visual evidence and external knowledge. Experiments demonstrate that VideoRover-8B-RL performs comparably to proprietary models in direct-answer tasks without tool use, while surpassing larger open-source models that utilize the same tools.
VideoRover unifies video reasoning and external knowledge retrieval, achieving competitive performance with fewer resources than larger models.
Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video and its parametric memory. While Thinking-with-Videos enables active temporal perception and Deep Research supports multi-step information seeking, the two capabilities are typically developed in isolation. We introduce VideoRover, a unified Video Deep Research framework that iteratively coordinates video cropping, multimodal search, and webpage browsing. Given a video-question pair, VideoRover uses each tool result to select the next action, so localized video clips guide external retrieval and retrieved evidence triggers further video inspection and verification. To develop this capability, we construct an automated data curation pipeline, producing 26K verified SFT trajectories and 3K challenging RL instances. We also introduce VideoRover-Bench, a benchmark stratified by video duration and research difficulty. Experiments on VideoDR and VideoRover-Bench show that our VideoRover-8B-RL achieves performance comparable to proprietary models in the direct-answer setting without tool use while outperforming larger open-source models equipped with the same tool suite. Ablation studies and training dynamics further validate the complementary roles of active video grounding, external retrieval, and long-horizon reinforcement learning.
