Search papers, labs, and topics across Lattice.
The paper introduces Latent sEmantic Distribution Alignment (LEDA), a novel approach for universal graph pre-training that addresses challenges in aligning diverse graph data and providing effective training guidance across domains. LEDA uses a dimension projection unit to adaptively align domain features into a shared semantic space and a variational semantic inference module to obtain and leverage a shared latent distribution for guiding domain projection. Experiments demonstrate that LEDA achieves strong performance across various graphs and downstream tasks, particularly excelling in few-shot cross-domain scenarios compared to in-domain baselines and other universal pre-training models.
Achieve SOTA in cross-domain graph few-shot learning by adaptively aligning diverse graph features into a shared semantic space.
Recent advances in generic large models, such as GPT and DeepSeek, have motivated the introduction of universality to graph pre-training, aiming to learn rich and generalizable knowledge across diverse domains using graph representations to improve performance in various downstream applications. However, most existing methods face challenges in learning effective knowledge from generic graphs, primarily due to simplistic data alignment and limited training guidance. The issue of simplistic data alignment arises from the use of a straightforward unification for highly diverse graph data, which fails to align semantics and misleads pre-training models. The problem with limited training guidance lies in the arbitrary application of in-domain pre-training paradigms to cross-domain scenarios. While it is effective in enhancing discriminative representation in one data space, it struggles to capture effective knowledge from many graphs. To address these challenges, we propose a novel Latent sEmantic Distribution Alignment (LEDA) model for universal graph pre-training. Specifically, we first introduce a dimension projection unit to adaptively align diverse domain features into a shared semantic space with minimal information loss. Furthermore, we design a variational semantic inference module to obtain the shared latent distribution. The distribution is then adopted to guide the domain projection, aligning it with shared semantics across domains and ensuring cross-domain semantic learning. LEDA exhibits strong performance across a broad range of graphs and downstream tasks. Remarkably, in few-shot cross-domain settings, it significantly outperforms in-domain baselines and advanced universal pre-training models.
