Search papers, labs, and topics across Lattice.
The paper introduces LENS, a novel architecture for sequential click-through rate (CTR) prediction that refines latent-query architectures by re-introducing target-specific control. LENS comprises a Target-Conditioned Query Gate (TCQG) and a Target-Conditioned Position Bias (TCPB) to improve target interaction within coarser bottlenecks of latent-query models. Experiments across various datasets and backbones demonstrate that LENS, combined with QueryPos, consistently improves performance, particularly in scenarios with varying item densities.
Revitalizing target-specific control within latent-query architectures for sequential CTR prediction yields consistent performance gains across diverse datasets and backbones, especially when combined with a simple position-aware reference.
In sequential CTR prediction, a central design question is at what granularity the target should interact with the user behaviour sequence. Existing models mainly follow two routes. Raw-item architectures such as DIN let the target score each item in the sequence directly. This relies on well-trained item embeddings and becomes brittle for sparse items. Latent-query architectures such as HyFormer, MixFormer, and OneTrans build query representations by combining the target with other information. This is more robust across item-density regimes but blunter: target-specific control is diluted. We propose LENS to restore target-specific control within these coarser bottlenecks. LENS has two modules: a Target-Conditioned Query Gate (TCQG) for query activation and a Target-Conditioned Position Bias (TCPB) for history retrieval. We further introduce Query-Specific Position Bias (QueryPos), a simple static position-aware reference for latent-query backbones. Across three representative latent-query backbones and four datasets, the combined QueryPos+LENS design achieves positive total-gain point estimates in all twelve evaluated backbone--dataset cells. We also identify a density-dependent conditioning rule: as item density decreases, the optimal condition source shifts from item-only to item-plus-sequence.
