Search papers, labs, and topics across Lattice.
This paper introduces RecoReward, a novel approach that leverages behavior-derived rewards for training multimodal large language models (MLLMs) to generate structured descriptions for recommendations without requiring user-specific information at inference. By utilizing historically engaged users as proxies for future targets and estimating shared affinities from non-target users, RecoReward effectively generates user-selective feedback through the Recommender Affinity Score (RAS). The method outperforms existing models in offline benchmarks and demonstrates significant performance improvements in online A/B testing, highlighting its effectiveness in enhancing recommendation systems while maintaining content-only inference.
Behavior-derived rewards enable MLLMs to generate effective recommendations without user-specific data at inference, outperforming traditional methods.
Multimodal large language models (MLLMs) can convert multimodal item content into structured descriptions used as semantic features for recommendation. Conventional content-only generation, however, cannot use downstream user signals to determine which semantics should be emphasized. Recent user-conditioned methods incorporate these signals through user histories or profiles, but they require user information at inference and make generation user-dependent. In this paper, we introduce RecoReward, which instead uses behavior-derived rewards during training and preserves content-only inference. To instantiate this idea in live-stream recommendation, we treat historically engaged users as a proxy for future target users and use observational non-target users to estimate affinity shared broadly across users. The Recommender Affinity Score (RAS) contrasts these signals to provide user-selective feedback for reinforcement learning, allowing the learned policy to generate a single shared description without user inputs. In our offline benchmark, RecoReward-9B outperforms its Qwen3.5-9B baseline and all other evaluated models across seven recall metrics. Online A/B testing also shows performance gains. These results show that RecoReward trains the MLLM to produce item features that benefit downstream recommendation while retaining content-only serving.
