Search papers, labs, and topics across Lattice.
This paper introduces OaK, an ontology-as-a-kernel framework that dynamically constructs and refines task-oriented ontologies for large language model (LLM) agents. By externalizing domain concepts and relations, OaK enhances knowledge retrieval and multi-step decision-making, addressing the limitations of traditional ontology construction methods. Evaluations on tasks such as TravelPlanner, CRMArenaPro, and ToolQA demonstrate that OaK significantly improves the performance and reliability of standard LLM agents in complex reasoning scenarios.
OaK transforms LLM agents by grounding their decision-making processes in dynamically constructed ontologies, leading to enhanced reliability in multi-step reasoning.
Large language model (LLM) agents rely heavily on knowledge encoded in model parameters or presented as unstructured context. In domain-specific tasks, this leaves important semantic connections implicit. This often results in incomplete evidence use and brittle multi-step decisions. Ontologies offer a way to externalize domain concepts and relations as machine-interpretable structures, but constructing task-usable ontologies traditionally requires substantial effort from domain experts and is difficult to scale. Automatic construction is also challenging: an ontology that appears semantically plausible may not contain the relational structures needed for actual decision making. We present OaK, an ontology-as-a-kernel framework that dynamically constructs and refines task-oriented ontologies for LLM agents. Given task requirements and training data, OaK constructs an ontology and its knowledge graph, generates task-adaptation functions for graph reasoning, and uses judge feedback to iteratively refine both. By making relevant concepts and relations explicit, the ontology grounds knowledge retrieval and multi-step decision making. We evaluate OaK on TravelPlanner, CRMArenaPro, and ToolQA. Results show that OaK improves standard LLM agents, strengthens evidence grounding, and boosts the reliability of multi-step reasoning.
