Search papers, labs, and topics across Lattice.
The paper introduces PAPerBench, a benchmark with 29,000 instances and context lengths from 1K to 256K tokens, to evaluate the impact of increasing context length on personalization and privacy in LLMs. Experiments on state-of-the-art LLMs reveal that both personalization performance and privacy protection degrade as context length increases. The authors attribute this degradation to attention dilution in long contexts, presenting a theoretical analysis to support this claim.
LLMs get worse at both personalization and privacy as you increase context length, revealing a fundamental scaling gap in current architectures.
Large language models (LLMs) are increasingly deployed in privacy-critical and personalization-oriented scenarios, yet the role of context length in shaping privacy leakage and personalization effectiveness remains largely unexplored. We introduce a large-scale benchmark, PAPerBench, to systematically study how increasing context length influences both personalization quality and privacy protection in LLMs. The benchmark comprises approximately 29,000 instances with context lengths ranging from 1K to 256K tokens, yielding a total of 377K evaluation questions. It jointly evaluates personalization performance and privacy risks across diverse scenarios, enabling controlled analysis of long-context model behavior. Extensive evaluations across state-of-the-art LLMs reveal consistent performance degradation in both personalization and privacy as context length increases. We further provide a theoretical analysis of attention dilution under context scaling, explaining this behavior as an inherent limitation of soft attention in fixed-capacity Transformers. The empirical and theoretical findings together suggest a general scaling gap in current models -- long context, less focus. We release the benchmark to support reproducible evaluation and future research on scalable privacy and personalization. Code and data are available at https://github.com/SafeRL-Lab/PAPerBench
