Search papers, labs, and topics across Lattice.
This paper introduces Rushes, a novel dataset designed to analyze human engagement preferences in interactive narrative environments through a game interface that logs user choices and evolving contexts. The dataset, comprising 44,226 decision events from 8,167 users, reveals that user choices follow structured patterns with low entropy, indicating that current state-of-the-art LLMs, including GPT-5, underperform compared to simpler baselines in predicting these choices. The findings highlight a significant Engagement Gap, suggesting that existing models are inadequate in capturing the nuanced, context-dependent preferences of individual users, thereby underscoring the limitations of population-level objectives in reinforcement learning from human feedback (RLHF).
State-of-the-art LLMs fail to capture nuanced user preferences, lagging behind simple baselines in predicting choices in interactive narratives.
We introduce Rushes, a dataset and benchmark for studying revealed human engagement preferences in interactive narrative environments. Rushes is collected through a game interface where users interact with AI-generated branching narratives and select one choice from a small, explicit candidate set at each decision point. Each interaction logs the full candidate set, the user's choice, and the evolving narrative context, yielding time-ordered trajectories with persistent user-level identifiers. Rushes contains 44,226 decision events from 8,167 unique users across six games, capturing sequential, personalized engagement behavior rather than static judgments. We show that user choices exhibit structured, non-random patterns, quantified by a low choice entropy relative to a uniform baseline. We position Rushes as a diagnostic benchmark for pluralistic alignment and demonstrate a robust Engagement Gap: state-of-the-art LLMs, including GPT-5, fail to outperform simple baselines. While classical Matrix Factorization (SVD) captures measurable personalized signal (37.7%), frontier LLMs (34.23%) struggle to even match the Popularity Baseline (36.4%) on event-level choice prediction. This gap suggests that single, population-level objectives, like those used in modern RLHF, appear insufficient to capture heterogeneous, context-dependent engagement signals. As a result, even highly capable models default to majority preferences rather than adapting to individual trajectories. We release Rushes to support research into pluralistic alignment and sequential decision-making in generative systems. The full code for the platform and dataset will be available here: https://github.com/microsoft/rushes
Microsoft Research