Search papers, labs, and topics across Lattice.
This paper introduces "Token Factory," a novel framework that efficiently integrates traditional signals into Large Recommendation Models (LRMs) by converting them into "soft tokens." By addressing the limitations of conventional methods that lead to long prompts and high computational costs, Token Factory enhances model performance while maintaining a manageable memory footprint. Experimental results demonstrate its effectiveness in real-world recommendation scenarios, showcasing significant improvements in processing efficiency and model output quality.
Transforming traditional signals into "soft tokens" could revolutionize how we integrate diverse data into Large Recommendation Models without compromising performance.
Large Recommendation Models (LRMs) have demonstrated promising capabilities in industry-scale recommendation tasks. However, holistically integrating traditional signals into these transformer-based architectures effectively and efficiently remains a major challenge. Conventional approaches that "textualize" these signals directly or create discrete item representations often lead to excessively long prompts, substantial memory footprints, and high computational overhead. To overcome these limitations, we propose "Token Factory", a framework designed to transform traditional signals into "soft tokens" that can be directly processed by LRMs. This approach enables efficient integration and compression of heterogeneous input features, preventing prompt length explosion while enhancing model performance. We detail the architecture of Token Factory and present experimental results validating its effectiveness in a production-scale recommendation environment.
DeepMind