Search papers, labs, and topics across Lattice.
This paper introduces DASH, a decision-aware user simulator that enhances online advertising evaluation by generating thinking traces alongside behavioral actions from diverse cross-domain histories. By addressing the limitations of existing simulators that rely solely on observable actions, DASH employs a Context Engineering stage and a tailored rubric-based reward model to improve both action prediction and the quality of reasoning. Experiments on real-world Tencent advertising data show that DASH significantly enhances the fidelity and diagnostic value of user simulations compared to traditional methods.
Action-only predictions miss the complexity of user preferences, but DASH captures decision-making processes for more accurate simulations in advertising.
Recent advances in LLM-based user simulation have shown promise for offline evaluation of recommendation and advertising systems. However, existing simulators typically infer user preferences from single-domain interaction histories and are primarily optimized to reproduce observable actions such as clicks. Consequently, they capture only a partial view of user preferences, while action-only prediction easily induces model shortcuts and limits both the fidelity and diagnostic value of simulation. To address these challenges, we propose DASH, a decision-aware user simulator that jointly generates thinking traces and predicts behavioral actions from heterogeneous cross-domain histories. DASH first introduces a Context Engineering stage that folds heterogeneous cross-domain histories into decision-relevant context, together with prompt optimization for effective reasoning over the folded context. To train a user simulator, DASH distills thinking trajectories from strong LLMs as SFT data, and further tailors a rubric-based reward model that evaluates thinking traces along form, content, and logic for RL training. Combined with the action reward, these signals jointly improve action prediction and thinking quality. Extensive experiments on real-world Tencent advertising data spanning five heterogeneous content domains demonstrate the effectiveness, efficiency, fidelity, and diagnostic value of DASH.
