Search papers, labs, and topics across Lattice.
This study rigorously reevaluates nine recent Graph Foundation Models (GFMs) for node property prediction, comparing their performance against established Graph Neural Network (GNN) baselines. The authors highlight the lack of a unified evaluation framework in the field, which has hindered reliable comparisons among GFMs and other models. The key finding reveals that only the latest GFMs, specifically those utilizing the Prior-data Fitted Networks paradigm, surpass well-tuned GNNs in predictive accuracy, albeit with increased inference costs.
Only the newest Graph Foundation Models can outperform traditional Graph Neural Networks in node property prediction, but they come at a higher computational cost.
Due to the wide use of graph-structured data in different fields of industry and science, the development of Graph Foundation Models (GFMs) has recently attracted a lot of attention. While many different types of models are called GFMs, particular interest has been paid to GFMs designed for node property prediction tasks, which is one of the most popular settings in Graph ML with lots of real-world applications from fraud detection in financial and social networks to recommendation systems for e-commerce and user-generated content platforms. While a number of GFMs for this task have been recently proposed, the field has not converged to a unified evaluation setting, and different works evaluate their models in widely different ways, preventing reliable comparison of GFMs with each other and with other types of models. In this work, we conduct a fair and rigorous reevaluation of 9 recent GFMs for node property prediction, comparing them to strong Graph Neural Network (GNN) baselines. We find that, among these GFMs, only the most recent ones based on the Prior-data Fitted Networks paradigm outperform well-tuned GNNs in predictive performance, although at a higher inference cost.