Search papers, labs, and topics across Lattice.
This paper introduces a two-stage framework for personalized video thumbnail generation that addresses the shortcomings of existing methods by tailoring thumbnails to individual user preferences. The first stage employs a personalized highlight retriever to select diverse visual anchors based on user-video interactions and video semantics, while the second stage utilizes a VLM-guided diffusion pipeline to generate visually coherent thumbnails. Experiments demonstrate that this approach outperforms state-of-the-art methods and significantly enhances user engagement through improved click preferences.
Personalized video thumbnails can significantly boost user engagement by aligning visual content with individual preferences, outperforming traditional methods.
Video thumbnails are a key factor for attracting user clicks on video platforms, and are increasingly supported by automation. However, existing thumbnail generation methods typically produce generic results shared across users, overlooking the diversity of individual preferences. We therefore introduce personalized video thumbnail generation, a novel task that aims to create thumbnails tailored to user-specific preferences. It is challenging in two aspects: (i) identifying visual anchors (i.e., key frames) from each video to guide the generation, which requires a balance between personalization and informativeness that existing highlight detection methods fail to achieve; and (ii) generating personalized thumbnails that are both visually coherent and faithful to the original video. As a response, we propose a two-stage framework that tightly couples preference-aware retrieval with controllable generation. In the first stage, a personalized highlight retriever captures fine-grained user-video interactions and incorporates video semantics through summarization, enabling the selection of diverse visual anchors aligned with both user preferences and video contexts. In the second stage, a VLM-guided diffusion pipeline transforms these anchors into thumbnails by extracting and injecting semantically grounded visual cues, improving personalization while preserving visual coherence and fidelity. Experiments on two public datasets show our method delivers state-of-the-art performance compared with both retrieval-based and generative baselines. A user study further demonstrates improved click preference, highlighting its effectiveness in enhancing user engagement. The code is available at https://github.com/hezy18/PVTG.