Search papers, labs, and topics across Lattice.
This paper introduces Popcorn, a configurable benchmark designed to enhance multimodal movie recommendation by integrating various visual evidence sources, including full movies, trailers, and thumbnails. The study reveals that different visual evidence sources yield distinct impacts on recommendation performance, with thumbnail visual language models (VLMs) offering scalable item-side evidence while the choice of source and fusion strategy significantly influences ranking accuracy and diversity. The findings underscore the importance of modality selection in recommender systems, providing a standardized framework for future research and application in this domain.
Visual evidence sources in movie recommendations are not interchangeable; the choice of modality can drastically alter ranking accuracy and diversity.
Movies are long-form audiovisual works, yet recommender benchmarks often rely on trailers, thumbnails, or metadata. These sources differ in semantics and scalability: full movies preserve consumption-level evidence, trailers concentrate promotional highlights, and thumbnails provide sparse but catalog-scale visual signals. We present Popcorn, a configurable benchmark for visual evidence in multimodal movie recommendation, combining title-aligned full-movie/trailer embeddings with MovieLens-linked thumbnail features encoded by modern visual and vision-language models. Popcorn standardizes modality assembly, fusion, splitting, evaluation, and LLM-augmented metadata through a single configuration contract. Experiments show that thumbnail VLMs provide strong, scalable item-side evidence, while controlled trailer/full-movie comparisons show that visual evidence sources are not interchangeable: the choice of source and fusion strategy affects ranking accuracy, coverage, diversity, and calibration. The framework is available at https://github.com/RecSys-lab/Popcorn.