Search papers, labs, and topics across Lattice.
This paper addresses the challenges of heterogeneous recommendation feeds in industrial-scale systems, specifically within Google Discover, by introducing HA-MoE, a heterogeneity-adaptive multi-gated mixture-of-experts architecture. The model effectively incorporates heterogeneity context into gating networks and expert representations, allowing for specialization without significant operational overhead. Evaluation results show consistent improvements in ranking performance and user engagement metrics, confirming the model's effectiveness in managing diverse content types in real-world applications.
HA-MoE achieves significant gains in user engagement by effectively managing the complexities of heterogeneous content in recommendation systems.
Heterogeneous recommendation feeds present complex challenges that extend beyond those found in highly homogeneous environments (e.g., music-only or video-only closed-ecosystem platforms). In Google Discover, a unified feed integrates diverse content sourced from the decentralized open web, including web articles, long-form and short-form videos, user-generated content (UGC), and beyond. Different content types exhibit distinct feature densities and user interaction patterns. Building a unified ranking model that sustains high performance across such heterogeneity, while avoiding negative transfer or majority bias, remains a significant industrial challenge. This paper presents an end-to-end case study on the industrial-scale multi-task ranking of heterogeneous feeds, grounded in real-world deployment. We introduce HA-MoE, a heterogeneity-adaptive multi-gated mixture-of-experts architecture that incorporates explicit heterogeneity context into both gating networks and expert representations. This approach enables effective specialization without significantly increasing operational overhead. To support reliable deployment, we introduce LENS, a lightweight observability framework that provides interpretable diagnostics of expert specialization and tracks this functional heterogeneity across continuous retraining. We evaluate our method using Dual-Level AUC (DL-AUC), a heterogeneity-aware evaluation metric that combines global ranking performance with cross-segment ranking correctness. Offline evaluations on a large-scale industrial dataset demonstrate consistent improvements over baseline models. Furthermore, online A/B testing confirms gains in feed activity and exploration metrics. Together, offline and online results validate the effectiveness of our approach for managing heterogeneity in industrial-scale recommender systems.
Google Research