Search papers, labs, and topics across Lattice.
SIREN addresses the challenge of integrating multi-modal features in lifelong user interest modeling for recommender systems by proposing a unified framework with multi-granularity semantic interaction. It introduces a General Search Unit with multi-modal similarity and SemID-based retrieval, and an Exact Search Unit incorporating target-aware relevance via similarity buckets and prefix-encoded SemIDs within a target-conditioned transformer. Offline experiments show state-of-the-art GAUC, and online A/B tests demonstrate significant GMV gains in various Weixin scenarios, leading to full-traffic deployment on Tencent's advertising platform.
Tencent's SIREN model boosts ad revenue by up to 3.87% in Weixin by unifying multi-modal and collaborative data into a single transformer, outperforming traditional late-fusion approaches.
Industrial recommender systems increasingly leverage lifelong user behavior histories and rich multi-modal content to capture evolving user preferences. However, effectively integrating multi-modal features into lifelong interest modeling remains challenging due to the inherent misalignment between multi-modal and collaborative spaces. Existing paradigms typically rely on separate modeling of multi-modal sequence and behavior sequence, and late fusion to alleviate the modality gap, which results in coarse-grained multi-modal representation and limited integration. In this paper, we propose SIREN, a unified multi-granularity semantic interaction framework for multi-modal lifelong user interest modeling. In the General Search Unit stage, we introduce two alternative retrieval strategies: multi-modal similarity-based soft retrieval for retrieval effectiveness, and Semantic ID (SemID)-based hard retrieval for efficient industrial serving. For the Exact Search Unit stage, we explicitly incorporate target-aware relevance via coarse similarity buckets and fine-grained prefix-encoded SemIDs, enabling unified interaction with collaborative ID features within the target-conditioned transformer architecture. Extensive experiments on the offline dataset demonstrate that SIREN achieves a state-of-the-art GAUC. Online A/B tests further demonstrate consistent GMV gains across multiple production scenarios, including +2.28% in Weixin Moments, +3.87% in Weixin Official Accounts, and +1.61% in Weixin Channels. From July 2025, SIREN has been fully launched for full-traffic serving in Tencent's advertising platform.
