Search papers, labs, and topics across Lattice.
This paper introduces the Video Candidate Generation (VCG) system, a multimodal retrieval framework tailored for e-commerce video feeds facing extreme cold-start challenges. By employing a domain-adapted vision-language model based on CLIP, VCG facilitates zero-shot retrieval of videos through visual content rather than relying on historical user interactions, effectively addressing the biases introduced by immersive video formats. Rigorous evaluations reveal that VCG not only outperforms traditional methods in mitigating engagement biases but also achieves a remarkable 50% increase in deep video completion rates through online A/B testing.
VCG achieves a 50% boost in deep video completion by transforming how e-commerce platforms retrieve content in the absence of user interaction history.
The digital commerce landscape is shifting from static, search-driven catalogs to dynamic, immersive video feeds. This transition introduces an ``extreme cold-start'' problem: unlike traditional items, new short-form videos lack the dense interaction history required for collaborative filtering. Furthermore, immersive feeds introduce strong position and duration biases that distort standard engagement signals. In this paper, we demonstrate the Video Candidate Generation (VCG) system, a scalable multimodal retrieval engine designed to solve these challenges in a large-scale e-commerce environment. By leveraging a domain-adapted vision-language model (based on CLIP), we map users and videos into a shared semantic space, enabling zero-shot retrieval based on visual content rather than behavioral history. We detail the system's architecture and present a rigorous evaluation comparing generative (LLM) vs. discriminative (CLIP) embeddings. Our results show that while generative models excel at attribute prediction, they suffer from embedding space collapse in retrieval tasks. Online A/B testing demonstrates that VCG effectively mitigates engagement biases, yielding a 50\% uplift in deep video completion. To showcase the system's capabilities, we present an interactive demonstration featuring three bi-directional retrieval scenarios: Product-to-Video, Video-to-Product, and Zero-Shot Semantic Search.