Search papers, labs, and topics across Lattice.
This paper introduces GTAlign, a novel Graph-to-Table Alignment framework that enables Tabular Foundation Models (TFMs) to effectively capture the structural information of graphs without relying on textual attributes. By pretraining a graph encoder to map diverse graphs into a unified latent space and employing community-guided continual pre-training, the model achieves significant improvements in node and graph classification tasks across five benchmark datasets. The results indicate that GTAlign outperforms existing state-of-the-art methods, highlighting its simplicity and effectiveness in multi-domain graph representation learning.
GTAlign achieves superior performance in graph classification tasks without the need for textual data, challenging the reliance on traditional graph neural networks and LLMs.
Graph Foundation Models (GFMs) have emerged as a promising paradigm for learning transferable representations across diverse graph domains. Recent advancements in GFMs have been largely dominated by two paradigms: Graph Neural Network and Large Language Model (LLM) based methods. However, these methods often face a fundamental dilemma between training with limited data and a heavy reliance on textual attributes. Tabular foundation models (TFMs) offer a potential alternative, as node features and representations can be naturally organized in a tabular form. However, how to enable TFMs to effectively capture structural information of graphs remains largely unexplored. The key challenge is to learn a graph-to-table alignment mechanism that enables graph structural understanding for TFMs. To address this, we propose GTAlign, a surprisingly simple yet effective Graph-to-Table Alignment framework for text-free Graph Foundation Model. Specifically, we first pretrain a graph encoder that maps diverse graphs into a unified latent space to capture domain-agnostic graph representations. To further bridge the gap between graph topology and the tabular representation space, we propose community-guided continual pre-training, where pseudo-labels derived from graph community are used to construct few-shot prediction episodes. Lastly, we adapt the graph encoder for an unseen target domain and perform in-context inference. Extensive experiments on five benchmark datasets demonstrate that GTAlign significantly outperforms state-of-the-art baselines on both node and graph classification, offering a simple, effective, and text-free GFM model. Code will be released upon acceptance.
Tsinghua AI