Search papers, labs, and topics across Lattice.
This paper introduces the Structure-Aware Optimal Transport (SAOT) framework for Self-Supervised Continual Graph Learning (CGL), addressing the limitations of existing methods that optimize node embeddings in isolation. By leveraging optimal transport theory, SAOT effectively captures and preserves global relational structures across sequential tasks, enhancing the learning of graph representations. Experimental results on four benchmark datasets show that SAOT significantly outperforms current self-supervised baselines, achieving up to 5% and over 15% accuracy improvements on CoraFull-CL and Products-CL, respectively.
SAOT achieves up to 15% accuracy gains in continual graph learning by preserving global relational structures that traditional methods overlook.
Self-supervised Continual Graph Learning (CGL) aims to successively learn from a graph sequence with different tasks without label supervision - a paradigm that has attracted widespread attention. Most existing self-supervised CGL methods rely on instance-level consistency objectives that enforce stability of individual node (or node-pair) embeddings. Due to optimizing nodes in isolation, these methods fail to maintain global relational structure, causing inter-node correspondences to progressively distort under continual learning. To this end, we propose a novel Structure-Aware Optimal Transport (SAOT) framework that explicitly captures and preserves relational structure within graph representations across sequential tasks. Specifically, SAOT leverages optimal transport theory to capture global inter-node correspondences, thereby facilitating and enhancing graph representation learning. Simultaneously, SAOT incorporates a cross-task knowledge distillation mechanism to preserve the previous structural knowledge. Extensive experiments on four CGL benchmark datasets demonstrate that SAOT outperforms existing self-supervised baselines. In particular, SAOT achieves significant performance gains, improving average accuracy by up to 5% on CoraFull-CL and over 15% on Products-CL compared with state-of-the-art methods in the Class-IL setting.
