Search papers, labs, and topics across Lattice.
This paper introduces a Graph Language Model (GLM)-based retriever designed for retrieval-augmented generation (RAG) over knowledge graphs, comparing its performance against graph neural network (GNN)-based and traditional vector-search retrievers. The study highlights that finetuned GLM retrievers outperform others in generalization to unseen domains, achieving state-of-the-art results on two multi-hop benchmarks while remaining competitive on in-domain datasets. Notably, GNN-based retrievers excel in graph coverage, and vector-search methods perform best in single-hop scenarios, indicating a nuanced landscape of strengths across different retriever types.
GLM retrievers not only set new benchmarks for multi-hop reasoning but also demonstrate superior transferability to unseen domains compared to traditional methods.
Retrieval-augmented generation (RAG) over knowledge graphs requires retrievers that can effectively capture both graph structure and semantic information. Recent approaches have explored graph neural network (GNN)-based retrievers to model graph topology in multi-hop reasoning tasks. In parallel, graph language models (GLMs) have emerged as a promising paradigm that integrates graph reasoning and the semantic capabilities of language models. In this work, we introduce a GLM-based retriever and investigate the comparative strengths of GLM-based, GNN-based, and traditional vector-search-based retrievers in single- and multi-hop RAG settings, and with a particular focus on transferability to unseen domains. Our findings suggest that finetuned GLM retrievers generalize better out of domain, achieving SOTA on two multi-hop benchmarks. On in-domain multi-hop QA datasets they remain comparable to prior work, with promising scaling as parameters and subgraph coverage increase. GNN-based retrievers achieve higher graph coverage with an efficient training setup, whereas the vector-search baseline excels at single-hop datasets.
