Search papers, labs, and topics across Lattice.
This paper introduces a content-hypothesis-driven shelf generation system for Spotify Home that replaces traditional fixed templates with natural-language hypotheses to create personalized recommendation shelves. By decoupling shelf planning from catalogue fulfilment, the system allows for independent optimization and supports generative retrieval, leading to a more scalable approach to catering to individual user tastes. The results indicate that this method significantly enhances the supply of personalized recommendations, achieving competitive engagement levels compared to existing systems, particularly for certain content types.
Hypothesis-driven shelves can dramatically increase the diversity of personalized recommendations while maintaining competitive engagement metrics.
Modern recommendation interfaces organise content into shelves: themed rows such as"More of What You Like"or"New Releases for You."In production systems, these shelves are typically defined through hand-crafted templates coupled with dedicated retrieval logic. While effective for broad recommendation intents, this approach does not scale to the long tail of individual taste. We present a content-hypothesis-driven shelf generation system for Spotify Home that replaces fixed templates with natural-language hypotheses describing what a personalised shelf should contain. The system has four stages hypothesis generation, catalogue fulfilment, shelf alignment, and offline serving. This decomposition decouples shelf planning from catalogue fulfilment, supports independent optimisation of planning and retrieval, and enables both constrained generative retrieval over catalogue entities and distillation of frontier LLM behaviour into compact models. Our production pipeline combines hypothesis generation, generative retrieval, candidate selection and shelf alignment, offline LLM-as-a-judge evaluation, and precomputed serving. We describe the end-to-end architecture and evaluate it through offline analyses and an early online evaluation under uniform random exposure on Spotify Home. Results show that hypothesis-driven shelves substantially expand personalised recommendation supply with engagement that varies by content type and is competitive with strong existing shelves in some settings.
