Search papers, labs, and topics across Lattice.
This paper introduces CM-PTM, a Cross Multi-source Behavior Pre-Training Model designed to enhance user representation learning in mobile games by addressing the complexities of user behavior across multiple sources and granularities. By utilizing hierarchical cascaded mask-then-predict tasks, CM-PTM captures the intricate dependencies and dynamics of user actions at both the source and app-action levels. Experimental results on large-scale datasets reveal that CM-PTM significantly improves performance in downstream mobile game recommendation tasks, effectively mitigating data sparsity issues.
Capturing the nuanced interplay of user behaviors across diverse sources, CM-PTM achieves unprecedented gains in mobile game recommendations.
User representation pre-training has become a fundamental paradigm for alleviating data sparsity in downstream personalization tasks. However, existing studies predominantly focus on single-app or app-level behaviors, overlooking the inherently cross-source and multi-granular nature of user activities on mobile devices. At the device level, user intent emerges from complex interactions among heterogeneous behavior sources and hierarchical action structures, posing challenges that cannot be addressed by conventional app-centric modeling. To tackle this issue, we propose CM-PTM, a novel Cross Multi-source Behavior Pre-Training Model tailored for mobile game user representation learning on device-level behavioral logs. CM-PTM employs hierarchical cascaded mask-then-predict proxy tasks that first infer the source of the next behavior and then progressively refine predictions at the app-action level. This design enables unified modeling of cross-source dependencies and fine-grained behavioral dynamics within a single pre-training paradigm. Extensive experiments on large-scale real-world mobile datasets demonstrate that CM-PTM effectively captures users' endogenous interests and consistently delivers significant performance gains on downstream mobile game recommendation tasks.
