Search papers, labs, and topics across Lattice.
This paper introduces Consensus Frame GRPO (CF-GRPO), a novel reward framework that enhances video reasoning in Video-MLLMs by leveraging intrinsic video cues to construct a consensus frame prior. By optimizing the agreement between visual and response representations through a high-contrast Consensus Frame Reward (CFR), the method circumvents the need for human temporal annotations while providing interpretable insights into the evidence frames utilized during training. Experimental results demonstrate that VideoCFR outperforms existing Video-MLLM and reinforcement learning baselines across various complex video reasoning benchmarks, highlighting its effectiveness in improving reasoning capabilities.
VideoCFR not only boosts performance in video reasoning tasks but also reveals the critical visual evidence driving model decisions without relying on human annotations.
Reinforcement learning has improved the reasoning ability of large language models, but applying outcome-only rewards to video multimodal large language models (Video-MLLMs) provides limited guidance on which visual evidence should support the answer. Inspired by multisensory integration, where consistent cues can enhance the salience and reliability of perceptual estimates, we introduce Consensus Frame GRPO (CF-GRPO), a temporal-annotation-free process-level reward framework for evidence-aware video reasoning. CF-GRPO constructs a consensus frame prior from intrinsic video cues, including temporal coverage, scene-transition cues, and query-conditioned visual relevance. It then computes a model-side frame-use score from visual and response representations and optimizes their agreement through the Consensus Frame Reward (CFR). With salience-aware sparse aggregation and distribution sharpening, CFR provides a high-contrast reward signal without requiring human temporal annotations. Experiments show that VideoCFR achieves competitive performance across complex video reasoning benchmarks and improves several metrics over representative Video-MLLM and RL baselines, while the consensus prior provides an interpretable view of the evidence frames emphasized during training. The implementation is available at https://github.com/1Pansy/VideoCFR.
NUS