Search papers, labs, and topics across Lattice.
GraphReview is introduced, a novel framework that leverages LLMs and graph message passing to improve scientific paper evaluation by jointly modeling intrinsic quality, synchronic links among contemporaneous papers, and diachronic links to prior work. LLMs estimate node-level quality priors and generate edge-level comparative evidence through pairwise paper comparisons, which are then integrated using Personalized PageRank for quality ranking, decision prediction, and review generation. Experiments demonstrate that GraphReview significantly outperforms existing methods, achieving substantial improvements in decision accuracy (23.7%) and ranking correlation (57.6%).
Stop evaluating papers in isolation: GraphReview's graph-based LLM framework boosts paper evaluation accuracy by nearly 30% by explicitly modeling relationships between papers.
Scientific paper evaluation often involves not only assessing a manuscript itself, but also relating it to contemporaneous research and prior literature. However, existing LLM-based methods typically model these signals separately and lack a unified mechanism for propagating review evidence across papers. We propose $\textbf{GraphReview}$, a graph-based LLM framework that formulates paper evaluation as review-signal message passing over a semantic paper graph. The graph jointly captures intrinsic quality, synchronic links among contemporaneous papers, and diachronic links to prior work. LLMs are used to estimate node-level quality priors and generate edge-level comparative evidence through pairwise paper comparisons, while Personalized PageRank integrates review signals for quality ranking, decision prediction, and review generation. To produce higher-quality graph evidence, we propose reward-induced maximum likelihood objectives for training the LLM backbones. Experiments show that GraphReview consistently outperforms the strongest baseline, achieving average improvements of 29.7% on decision and ranking metrics, including gains of 23.7% in Accuracy and 57.6% in Spearman's $\rho$. It also produces higher-quality review texts and generalizes effectively across time periods and conference venues. The code is available at https://github.com/ECNU-Text-Computing/GraphReview.
