Search papers, labs, and topics across Lattice.
This paper extends a sensitivity-aware PAC-Bayesian framework to message passing graph neural networks (MPGNNs) to address their vulnerability to adversarial attacks. By deriving output Jacobians and constructing Jacobian-aligned sensitivity matrices, the authors achieve tighter robust generalization bounds that are less dependent on hidden-width complexity and more aligned with the number of classes in graph classification. The key result demonstrates that these refined bounds significantly enhance the adversarial robustness of MPGNNs, providing a clearer pathway for their design improvements.
Tighter generalization bounds for MPGNNs reveal that adversarial robustness can be significantly improved by focusing on parameter sensitivity rather than hidden-width complexity.
Whilst the vulnerability of graph neural networks (GNNs) to adversarial attacks poses a critical threat to graph representation learning, the understanding of the robust generalization behavior remains a fundamental challenge in the adversarial setting. Recently, PAC-Bayesian margin-based generalization analysis substantially advances this line of research by providing a flexible and data-dependent analytical framework. However, existing robust analyses often rely on isotropic Gaussian posteriors and control weight perturbations in the full parameter space, which limits the ability to capture heterogeneous parameter sensitivity yet hinges on hidden-width-dependent complexity terms, resulting in not-tight-enough generalization bounds. In this paper, we extend a recently proposed sensitivity-aware PAC-Bayesian framework from deep neural networks to message passing GNNs (MPGNNs) and derive a tighter robust generalization bound in the adversarial setting. Specifically, we first quantify how sensitive the perturbations across different parameter blocks are to the network outputs by deriving the output Jacobians with respect to the weight parameters. Exploiting the fact that these Jacobian matrices have rank at most $K$ in $K$-class graph classification, we then construct Jacobian-aligned sensitivity matrices and use anisotropic Gaussian posteriors with optimized covariances to upper bound the KL divergence in a tight way. Notably, by refining the spectral-norm dependence on the learned weights and reducing the leading dimension factor from hidden-width-dependent terms to the number of classes $K$, our analysis yields much tighter robust generalization guarantees for MPGNNs, thereby guiding their designs to enhance adversarial robustness.
