Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
We introduce a unified, mode-wise stability framework to characterize over-smoothing in deep GNNs by interpreting layer updates as graph-coupled dynamics and layer depth as time. This framework reveals over-smoothing as undesirable feature synchronization, with the master stability curve assessing synchrony stability. Guided by this theory, we propose Stability-Shaped Deep Graph Learning (SDGL), which employs controlled Turing instability or stable near-critical propagation to achieve improved depth scaling and accuracy on node- and graph-level tasks.
Deep GNNs can achieve superior depth scaling and accuracy by leveraging controlled Turing instability or stable near-critical propagation to combat over-smoothing.
In deep graph neural networks, increasing depth enlarges the receptive field but often leads to over-smoothing, where node representations tend to align. We develop a unified, mode-wise stability framework for deep GNN propagation that provides a principled characterization of over-smoothing. By interpreting layer depth as time and layer updates as graph-coupled dynamics, over-smoothing can be understood as an undesirable dynamical synchronization of features, for which the master stability curve provides a theoretical tool to assess the stability of synchrony. Guided by this theory, we further propose Stability-Shaped Deep Graph Learning (SDGL) to mitigate over-smoothing in deep GNNs. SDGL has two complementary instantiations: one induces controlled Turing instability to replace synchronization with spatial pattern formation, and the other maintains stable near-critical propagation. Experiments on diverse node- and graph-level benchmarks demonstrate the improved depth scaling and consistent accuracy gains over strong baselines, including graphs exhibiting long-range dependencies.