Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper tackles the cold-start problem in recommender systems by training a purely content-based model, avoiding alignment with collaborative filtering (CF) embeddings. They introduce a sparse contrastive learning objective, SEMCo, based on sampled softmax loss with $\alpha$-entmax activations to improve item relevance estimation by zeroing gradients for uninformative negatives. Experiments demonstrate that SEMCo, extended with knowledge distillation, outperforms existing cold-start methods and standard sampled softmax in ranking accuracy, while also improving equity of item outcomes.
Content-based cold-start recommendation gets a boost from sparse contrastive learning, showing that selectively ignoring uninformative negative samples sharpens item relevance estimation and beats standard softmax.
Item cold-start is a pervasive challenge for collaborative filtering (CF) recommender systems. Existing methods often train cold-start models by mapping auxiliary item content, such as images or text descriptions, into the embedding space of a CF model. However, such approaches can be limited by the fundamental information gap between CF signals and content features. In this work, we propose to avoid this limitation with purely content-based modeling of cold items, i.e. without alignment with CF user or item embeddings. We instead frame cold-start prediction in terms of item-item similarity, training a content encoder to project into a latent space where similarity correlates with user preferences. We define our training objective as a sparse generalization of sampled softmax loss with the $\alpha$-entmax family of activation functions, which allows for sharper estimation of item relevance by zeroing gradients for uninformative negatives. We then describe how this Sampled Entmax for Cold-start (SEMCo) training regime can be extended via knowledge distillation, and show that it outperforms existing cold-start methods and standard sampled softmax in ranking accuracy. We also discuss the advantages of purely content-based modeling, particularly in terms of equity of item outcomes.