Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces KGT, a framework designed to bridge the granularity mismatch between LLMs and KGs for knowledge graph completion by using dedicated entity tokens for full-space prediction. KGT fuses pre-trained structural and textual features into unified entity embeddings using a relation-guided gating mechanism, avoiding the need for end-to-end training. Experiments demonstrate that KGT outperforms state-of-the-art methods on multiple knowledge graph completion benchmarks by decoupling semantic and structural reasoning with independent prediction heads.
Knowledge Graph Completion gets a boost: KGT's dedicated entity tokens and decoupled prediction heads let LLMs reason about KGs without being constrained by token fragmentation.
Leveraging Large Language Models (LLMs) for Knowledge Graph Completion (KGC) is promising but hindered by a fundamental granularity mismatch. LLMs operate on fragmented token sequences, whereas entities are the fundamental units in knowledge graphs (KGs) scenarios. Existing approaches typically constrain predictions to limited candidate sets or align entities with the LLM's vocabulary by pooling multiple tokens or decomposing entities into fixed-length token sequences, which fail to capture both the semantic meaning of the text and the structural integrity of the graph. To address this, we propose KGT, a novel framework that uses dedicated entity tokens to enable efficient, full-space prediction. Specifically, we first introduce specialized tokenization to construct feature representations at the level of dedicated entity tokens. We then fuse pre-trained structural and textual features into these unified embeddings via a relation-guided gating mechanism, avoiding training from scratch. Finally, we implement decoupled prediction by leveraging independent heads to separate and combine semantic and structural reasoning. Experimental results show that KGT consistently outperforms state-of-the-art methods across multiple benchmarks.