Search papers, labs, and topics across Lattice.
This paper introduces KARLA, a method that enables language models to incorporate factual knowledge from a knowledge base during token generation, enhancing the accuracy and relevance of their outputs. By allowing for real-time updates to factual information without the need for retraining, this approach improves transparency and explainability by linking outputs directly to the knowledge base. Experimental results demonstrate that smaller models can achieve comparable factual accuracy to larger models, significantly advancing the capabilities of LLMs in generating grounded content.
Smaller language models can now match the factual accuracy of their larger counterparts by dynamically querying a knowledge base during generation.
We propose a new method that allows an LLM to automatically pull in factual knowledge from a knowledge base during token generation. This means that (1)~factual knowledge in the LLM output can be updated without retraining the LLM, (2)~facts in the LLM output can be traced to the knowledge base for transparency and explainability, and (3)~smaller models can achieve the same factual accuracy as larger models. Our core idea is to train the model to produce special tokens that trigger a query to the knowledge base. Our experiments show that our method improves factual grounding in both short and long-form generation, and allows factual revisions to take effect through KB edits rather than parameter updates.
