Search papers, labs, and topics across Lattice.
This paper investigates the "Information Abundance Paradox," revealing that while training large language models (LLMs) with long contexts can enhance certain performance metrics, it ultimately undermines parametric knowledge retention. The authors demonstrate that increasing context windows initially improves language modeling and understanding, but beyond a certain point, performance declines due to a shift in learning dynamics from parametric encoding to contextual reliance. Their findings indicate that excessive context can lead to a lower complexity solution, diminishing robustness when context is absent or misleading during inference.
Training LLMs with long contexts can paradoxically weaken their ability to retain knowledge, leading to poorer performance when context is not available.
Large language models are increasingly trained and deployed with long contexts that span documents, code repositories, and interaction histories. This scaling reflects the implicit assumption that training on longer contexts will only help the model by exposing it to richer evidence. We challenge this view by studying how the context window shapes a model's mode of learning, shifting it between parametric internalization and contextualization. We propose the Information Abundance Paradox, which hypothesizes that abundant relevant information in the training context can reduce the incentive to encode that information parametrically, thereby increasing reliance on context. In pretraining with long documents, increasing the context window improves language modeling, natural language understanding, and closed-book MCQA only up to an intermediate optimum, after which performance consistently declines. In supervised fine-tuning, more task-relevant train-time context improves performance with supporting context, but reduces robustness when context is absent or misleading at test time. Our analysis suggests that this behavior arises when longer context provides a lower complexity solution. Mechanistically, training with informative context shifts gradient pressure from feed-forward networks, often linked to parametric knowledge, toward attention modules, and causal interventions show that this shift increases reliance on context during inference. Overall, these findings support the Information Abundance Paradox and suggest that scaling toward near-infinite context is not simply a matter of supplying more data, even when high-quality long-context data is abundant.
