Search papers, labs, and topics across Lattice.
The paper introduces UltraVQA, a large-scale multi-dimensional VQA dataset with UGC videos annotated across five quality dimensions, each with fine-grained sub-attribute labels and GPT-generated rationales. To improve discrete quality score assessment, they propose Analytic Score Optimization (ASO), a post-training objective derived from reframing quality assessment as a regularized decision-making process. ASO, which has a closed-form solution that captures the ordinal nature of human ratings, outperforms baselines and reduces MAE in quality prediction.
Forget single-number video quality scores: UltraVQA and Analytic Score Optimization (ASO) unlock richer, multi-faceted evaluations that better align with human preferences.
Video Quality Assessment (VQA) is evolving beyond single-number mean opinion score toward richer, multi-faceted evaluations of video content. In this paper, we present a large-scale multi-dimensional VQA dataset UltraVQA that encompasses diverse User-Generated Content~(UGC) annotated across five key quality dimensions: Motion Quality, Motion Amplitude, Aesthetic Quality, Content Quality, and Clarity Quality. Each video in our dataset is scored by over 3 human raters on these dimensions, with fine-grained sub-attribute labels, and accompanied by an explanatory rationale generated by GPT based on the collective human judgments. To better leverage these rich annotations and improve discrete quality score assessment, we introduce Analytic Score Optimization (ASO), a theoretically grounded post-training objective derived for multi-dimensional VQA. By reframing quality assessment as a regularized decision-making process, we obtain a closed-form solution that naturally captures the ordinal nature of human ratings, ensuring alignment with human ranking preferences. In experiments, our method outperforms most baselines including closed-source APIs and open-source models, while also reducing mean absolute error (MAE) in quality prediction. Our work highlights the importance of multi-dimensional, interpretable annotations and reinforcement-based alignment in advancing video quality assessment.
