Search papers, labs, and topics across Lattice.
This study empirically evaluates six interventions aimed at mitigating feedback loops in YouTube Music's recommendation system, which suppresses both new releases and unlistened catalog items. By conducting off-policy online A/B tests across serving, training, architecture, and exploration layers, the authors find that while architectural debiasing enhances diversity, it fails to foster discovery, and serving-time interventions are ineffective due to the learning loop. Notably, uncertainty-driven exploration using a Spectral-normalized Neural Gaussian Process (SNGP) head yields the most significant lift in new releases, albeit with trade-offs in engagement and diversity.
Uncertainty-driven exploration can significantly boost new release visibility in music recommendations, but at the cost of user engagement and diversity.
Continuously trained ranking models in music recommenders fall into feedback loops where previously consumed items dominate recommendations. This suppresses two distinct content classes: new releases (temporal freshness) and unlistened catalog items (novelty). Industry practitioners have a wide menu of interventions available, ranging from serving-time heuristics, training-data reweighting, architectural debiasing, to uncertainty-driven exploration, each of which are well understood in academic settings. But live systems offer challenges with continuously ingested content, interconnected components, and practical limitations that counteract the findings from academic research. We report results from off-policy online A/B tests for six interventions and a combination experiment across four conceptual layers (serving, training, architecture, exploration) on the YouTube Music homepage. All interventions modify the ranking model or the serving layer that consumes its scores; candidate generation and other upstream components are held fixed. We discuss key takeaways from our results: first, serving-time interventions on continuously trained systems are neutralized by the learning loop. Second, architectural debiasing reduces popularity dominance and improves diversity but does not create discovery, while carrying hidden integration costs. Finally, uncertainty-driven exploration interventions with a Spectral-normalized Neural Gaussian Process (SNGP) head produce the largest new-release lift, though they come with a measurable engagement or diversity tradeoff. We close with recommendations on which layer to intervene at, and the hidden costs of each choice.