Search papers, labs, and topics across Lattice.
The paper introduces BenchPreS, a benchmark to evaluate context-aware application of user preferences stored in persistent memory by LLMs in third-party communication scenarios. It uses Misapplication Rate (MR) and Appropriate Application Rate (AAR) to quantify the degree to which LLMs inappropriately apply or correctly suppress user preferences based on context. Experiments reveal that even state-of-the-art LLMs struggle to apply preferences contextually, often treating them as globally enforced rules, and that neither reasoning nor prompt engineering fully mitigates this.
LLMs struggle to selectively apply user preferences stored in memory, often misapplying them even when social norms dictate otherwise, revealing a critical gap in context-aware personalization.
Large language models (LLMs) increasingly store user preferences in persistent memory to support personalization across interactions. However, in third-party communication settings governed by social and institutional norms, some user preferences may be inappropriate to apply. We introduce BenchPreS, which evaluates whether memory-based user preferences are appropriately applied or suppressed across communication contexts. Using two complementary metrics, Misapplication Rate (MR) and Appropriate Application Rate (AAR), we find even frontier LLMs struggle to apply preferences in a context-sensitive manner. Models with stronger preference adherence exhibit higher rates of over-application, and neither reasoning capability nor prompt-based defenses fully resolve this issue. These results suggest current LLMs treat personalized preferences as globally enforceable rules rather than as context-dependent normative signals.
