Search papers, labs, and topics across Lattice.
Open-o3-Video-v2 enhances verifiable video reasoning by formulating it as an agentic process that actively seeks and grounds spatio-temporal evidence, including object-level bounding boxes and timestamps, to support its reasoning trajectory. This is enabled by the new STGR-v2-CoT135K and STGR-v2-RL-13K datasets and the Clue-Seek GRPO (CS-GRPO) training method, which rewards informative evidence retrieval. The model achieves state-of-the-art performance on V-STaR, significantly outperforming its backbone and demonstrating the efficacy of active evidence acquisition and object-level grounding for reliable video understanding.
LLMs can now actively seek and ground verifiable spatio-temporal evidence, including object bounding boxes, to improve video reasoning accuracy by over 12%.
Reliable video reasoning requires models to produce correct answers and expose supporting visual evidence. Open-o3-Video enables verifiable reasoning by embedding timestamps and object-level bounding boxes into reasoning traces, but is restricted to frames from an initial sparse sampler. We introduce Open-o3-Video-v2, which formulates video reasoning as a unified agentic evidencegrounded process. The model identifies missing information, acquires additional observations, grounds the moments and objects supporting its reasoning, and writes this evidence into the trajectory before continuing or answering. To support this behavior, we construct STGR-v2-CoT135K, including 52K multi-turn agentic grounded reasoning trajectories, and STGR-v2-RL-13K for reinforcement learning. We further propose Clue-Seek GRPO (CS-GRPO), which tracks how tool calls change accumulated evidence, rewards clue coverage and step-wise gains, and penalizes excessive, repetitive, or uninformative retrieval. On V-STaR, Open-o3-Video-v2-4B achieves 40.4% mAM and 56.3% mLGM, outperforming its Qwen3-VL-4B backbone by 8.5% and 12.6%, respectively. It also delivers consistent gains across general video understanding, long-video reasoning, and temporal grounding benchmarks. These results show that active evidence acquisition and verifiable object-level grounding are complementary for reliable video reasoning. The code and models are released at https://msalab-pku.github.io/projects/Open-o3-Video-v2.