Search papers, labs, and topics across Lattice.
This paper introduces Interactor, an agentic reinforcement learning framework designed for the iterative generation of ad descriptions in sponsored search. By leveraging a multi-turn interaction with customized generative reward models that assess various quality dimensions, the framework refines ad descriptions based on feedback to enhance their informativeness and relevance. Experimental results demonstrate that Interactor significantly surpasses existing methods, leading to improved ad revenue and user experience in real-world applications since its deployment in May 2026.
Iterative feedback-driven ad description generation can dramatically enhance both user engagement and revenue in sponsored search.
This paper focuses on automatically generating informative ad descriptions in sponsored search. Unlike ad titles which are usually optimized to attract user click feedbacks, ad descriptions have a longer text span and possess the potential of incorporating world knowledge to address user search intents while presenting the fine-grained selling points of the ads. We propose Interactor, a multi-turn iterative creation framework optimized with agentic RL for ad description generation. The generation model acts as a policy that interacts with a customized environment consisting of multiple generative reward models. Given initial generations by the policy, the customized GenRMs evaluate multi-dimensional qualities including knowledge capacity and landing page consistency, providing both binary signals and reasoning feedbacks. The policy then iteratively refines the descriptions based on such feedbacks to ensure continuous improvement. Experiments on industrial datasets show that the Interactor framework significantly outperforms state-of-the-art approaches in generating knowledge-rich and faithful ad descriptions. Since May 2026, it has been deployed online in a leading search ads system, contributing to both ad revenue and user experience.
