Search papers, labs, and topics across Lattice.
This paper introduces Claim-Level Rubric Rewards (CuRe), a novel reward framework aimed at overcoming the limitations of existing reward designs in reinforcement learning for dense video captioning. By decomposing captions into category-aware atomic claims, CuRe shifts the focus from holistic evaluations and rigid reference alignments to a more structured claim-level verification approach. The key finding demonstrates that this method enhances factual accuracy and preserves the diversity of generated captions, thereby improving overall performance in video captioning tasks.
CuRe transforms video captioning reward design by shifting from holistic evaluations to precise claim-level verification, significantly boosting factual accuracy and diversity in generated captions.
In this paper, we introduce Claim-Level Rubric Rewards (CuRe), a structured reward framework designed to address the reward-design bottleneck in reinforcement learning for dense video captioning. Existing reward designs generally fall into two categories: holistic response-level judgment across heterogeneous criteria, or alignment-based evaluation against reference captions. However, both paradigms suffer from fundamental limitations. Holistic rewards struggle to ensure factual accuracy and are prone to stylistic reward hacking, while reference-based rewards overly rely on rigid textual alignment, failing to preserve the completeness and diversity inherent to open-ended generation tasks. To address these challenges, CuRe reformulates reward modeling as fine-grained claim-level verification. Specifically, CuRe decomposes captions into category-aware atomic claims through a structured rubric, converting holistic evaluation into simpler and more reliable claim-level verification.
Tsinghua AI