Search papers, labs, and topics across Lattice.
This paper introduces Peak-End-Net, a novel framework for video aesthetic assessment (VAA) that leverages the psychological peak-end rule to enhance the evaluation of video aesthetics. By integrating a pretrained image aesthetic assessment head and an aesthetic rhythm encoder, the framework identifies salient moments and captures temporal progression, leading to improved robustness against distribution shifts. Extensive evaluations on two VAA benchmarks reveal that Peak-End-Net achieves state-of-the-art performance, highlighting the effectiveness of psychologically informed approaches in aesthetic judgment.
Aesthetic assessments can be dramatically improved by focusing on key moments and endings, as shown by Peak-End-Net's state-of-the-art results in video evaluation.
Video aesthetic assessment (VAA) aims to predict how aesthetically pleasing a video is, yet remains far less explored than other visual assessment tasks. Its progress is hindered not only by the scarcity of large-scale benchmarks, but also by the intrinsic subjectivity of aesthetic judgment, which is shaped by human perception. In this paper, we revisit VAA from a psychological perspective and propose \textit{Peak-End-Net}, a lightweight and interpretable framework inspired by the \textit{peak-end rule}, which suggests that people tend to judge a temporal experience mainly according to its salient moments and the ending. Building on this intuition, we first transfer knowledge from image aesthetic assessment (IAA) to VAA by introducing a pretrained IAA head to produce frame-wise aesthetic priors, which serve as surrogate signals for identifying aesthetically salient moments and guiding \textit{peak-end rule}-based temporal aggregation. To further capture how a video evolves aesthetically over time, we design an aesthetic rhythm encoder that models temporal progression beyond isolated moments. Additionally, we refine the overall assessment through a dynamic gated fusion mechanism to improve robustness under distribution shift. Our method is built on a frozen vision transformer (ViT) and requires only a small number of trainable parameters, making it scalable and parameter-efficient. Extensive experiments on two existing VAA benchmarks, including in-domain evaluation on VADB and cross-domain testing on DIVIDE-3K, demonstrate that our approach achieves state-of-the-art performance, affirming the value of psychologically grounded modeling for VAA. Our code and models are available at https://github.com/AMAP-ML/Peak-End-Net.
DAMO