Search papers, labs, and topics across Lattice.
This paper addresses the issue of oversmoothing in Graph Convolutional Networks by introducing Sheaf Neural Networks (SNNs), which utilize a sheaf structure and a sheaf Laplacian to enhance discriminative capacity. The authors critique existing methods that rely solely on the absolute dimension of the harmonic space as an indicator of anti-oversmoothing capacity, proposing instead a relative, geometric approach that provides a more reliable characterization. Their index-theoretic criterion demonstrates that certain sheaf configurations can genuinely enrich the harmonic space, supported by experiments showing that compliant models maintain stable representations while those that violate the criterion collapse.
Oversmoothing in graph neural networks can be effectively tackled by a new index-theoretic criterion that reveals the true discriminative power of sheaf configurations.
To combat oversmoothing in Graph Convolutional Networks, Sheaf Neural Networks (SNNs) were proposed as a generalization by equipping the graph with a sheaf structure and replacing the graph Laplacian with a sheaf Laplacian $\mathcal{L}$. Existing analyses connect sheaf diffusion to oversmoothing via the harmonic space ($\ker\mathcal{L}$), taking its absolute dimension as an indicator of anti-oversmoothing capacity. However, absolute dimension alone is not a reliable measure: certain sheaf configurations inflate $\dim \ker \mathcal{L}$ while their harmonic sections remain entirely constant, without enriching discriminative capacity. We instead introduce the first relative, geometric approach, yielding a precise characterisation of anti-oversmoothing capacity. Under natural conditions on stalk transportation and global sheaf structure, we establish an index-theoretic comparison criterion showing that one sheaf's harmonic space genuinely contains another's beyond trivial inflation. We illustrate this with a concrete instance and further introduce \textit{GyroSheaf}, a sheaf with curved gyrovector-space stalks, extending the criterion to the non-linear setting via local tangent-space linearization. Experiments across ten models confirm the theoretical criterion: sheaf models violating the criterion collapse despite possessing index jumps, while compliant models maintain depth-stable representations.
