Search papers, labs, and topics across Lattice.
This paper introduces a self-supervised hard negative sampling technique that utilizes a large language model (LLM) to generate challenging negatives from clustered data during the training of two-tower retrieval models. By addressing the limitations of traditional negative sampling methods, which often produce easy negatives, this approach enhances the model's ability to learn from more informative examples. Experimental results and real-world deployment indicate that this method outperforms existing industry standards, effectively mitigating popularity bias and improving recommendation quality.
Hard negatives generated in real-time by LLMs can significantly enhance the training of two-tower models, outperforming traditional sampling methods and reducing popularity bias in recommendations.
The two-tower model has been widely used for large-scale recommendation systems, particularly in the retrieval stage. Industry standards for training two-tower models typically involve in-batch and/or out-of-batch negative sampling. However, these methods often produce easy negatives that models can quickly learn, failing to sufficiently challenge the model. To address this issue, a novel self-supervised hard negative sampling technique is proposed that leverages a large language model (LLM) to generate hard negatives from the same cluster during model training. By utilizing the LLM to learn media representations, the proposed approach ensures that the generated negatives are more challenging and informative. This real-time sampling framework is designed for seamless integration into production models, capable of handling billions of training data points with minimal computational complexity. Experiments on public datasets, along with deployment to a large-scale online system, demonstrate that the proposed negative sampling technique outperforms widely used industry methods. Furthermore, analysis in industrial applications reveals that this sampling method can help break inherent feedback loops in recommendations and significantly reduce popularity bias.
