Search papers, labs, and topics across Lattice.
This keynote addresses the challenge of understanding how Language Models (LMs) integrate parametric knowledge (embedded in weights) with contextual knowledge for knowledge-intensive tasks. It highlights the problem of LMs ignoring context due to conflicts with pre-existing knowledge or intra-memory conflicts within the model's parameters. The talk will present research on evaluating knowledge in LMs, diagnostic tests for revealing knowledge conflicts, and understanding the characteristics of successfully used contextual knowledge.
Language models often disregard provided context, choosing instead to rely on potentially outdated or conflicting information learned during pre-training, revealing a critical flaw in their knowledge integration.
Language Models (LMs) acquire parametric knowledge from their training process, embedding it within their weights. The increasing scalability of LMs, however, poses significant challenges for understanding a model's inner workings and further for updating or correcting this embedded knowledge without the significant cost of retraining. Moreover, when using these language models for knowledge-intensive language understanding tasks, LMs have to integrate relevant context, mitigating their inherent weaknesses, such as incomplete or outdated knowledge. Nevertheless, studies indicate that LMs often ignore the provided context as it can be in conflict with the pre-existing LM's memory learned during pre-training. Conflicting knowledge can also already be present in the LM's parameters, termed intra-memory conflict. This underscores the importance of understanding the interplay between how a language model uses its parametric knowledge and the retrieved contextual knowledge. In this talk, I will aim to shed light on this important issue by presenting our research on evaluating the knowledge present in LMs, diagnostic tests that can reveal knowledge conflicts, as well as on understanding the characteristics of successfully used contextual knowledge.
