Search papers, labs, and topics across Lattice.
This paper introduces GRAFT, a novel generative retrieval approach that utilizes a graph-based structure to enhance the exploration of scientific literature by connecting papers through four distinct facets: problem, method, result, and contribution. By employing coverage-aware distillation and constrained decoding, GRAFT achieves a remarkable 91% Recall@20 on a custom corpus of 11,359 NLP papers, while also outperforming traditional citation-based methods on out-of-sample queries. The method not only ensures valid paper retrieval but also provides clear facet labels for each returned paper, facilitating a more nuanced understanding of the literature's relationships.
GRAFT achieves 91% Recall@20 without relying on nearest-neighbour indexing, revolutionizing how researchers can explore scientific literature through facet-aware generative retrieval.
Scientific papers may relate by problem, method, result, or contribution, but document-level retrievers collapse these into a single similarity score without saying why they are related. Citation- and similarity-based retrieval alone also confines search to the neighbourhood of what is already known, whereas generative retrieval generates document identifiers directly, enabling the exploratory retrieval that scientific discovery depends on. We connect papers in a graph whose edges are typed by these four facets, derived from facet items and citation signals, and distil it into a generative retriever whose identifiers are the papers' own facet text. Two graph properties do not survive naive distillation. First, because every training pair is an edge, naive enumeration indexes just 84% of the corpus. Coverage-aware distillation makes every paper learnable through a reverse-neighbour fallback, a minimum-coverage threshold, and edge-importance weighting. Second, constrained decoding guarantees that every generated identifier is a valid paper, but not that the graph connects it to the query. Graph-weighted reciprocal rank fusion scales each candidate's rank term by its query-candidate edge weight, dropping unsupported ones. On LitWeave, our constructed corpus of 11,359 NLP papers, Graft recovers 91% of its graph teacher's Recall@20 with no nearest-neighbour index or encoder at inference, and outperforms the graph teacher on query papers outside the corpus. It reproduces the graph's own facet labels at 0.922 precision, so every returned paper arrives labelled with the facet that surfaced it rather than an opaque score.
