Search papers, labs, and topics across Lattice.
This paper systematically benchmarks Sheaf Neural Networks (SNNs) for inductive tasks, addressing a critical gap in understanding their performance beyond transductive node classification. The authors evaluate various diffusion mechanisms, restriction-map parameterizations, stalk dimensions, and GNN architectural components across 1,890 experiments on 14 inductive datasets. Key findings reveal that while restriction maps are crucial for design, SNNs still lag behind the strongest baselines in inductive settings, indicating a need for further architectural optimization rather than solely focusing on sheaf-specific parameters.
Restriction maps dominate the design choices in Sheaf Neural Networks, but they still struggle to outperform leading models in inductive tasks.
Sheaf Neural Networks (SNNs) generalize message passing by replacing scalar edge weights of standard Graph Neural Networks (GNNs) with learnable, edge-dependent restriction maps between node stalks. Despite their strong theoretical foundations and promising transductive results, SNNs have been evaluated almost exclusively on transductive node classification, leaving their behaviour under inductive protocols unknown. We address this gap through the first systematic benchmark of the sheaf design space, evaluating three diffusion mechanisms (neural sheaf diffusion, sheaf attention, and sheaf attention with Graph Attention Network v2), three restriction-map parameterizations, three stalk dimensions, and six modern GNN architectural components, within a message-passing reformulation that never assembles the heavy sheaf Laplacian, making the full design space trainable under cross-graph batching. Across $1{,}890$ controlled experiments on 14 inductive datasets, multiple insights emerge: restriction maps are the dominant design choice and general maps are preferable, larger stalks add capacity but not long-range reach, architectural components explain more performance variation than the entire sheaf-specific design space itself. Under a matched protocol, SNNs transfer to inductive settings but do not reach the strongest baselines, with gaps being dataset-dependent. Practically, a single sheaf configuration can generalize across datasets, so effort is better spent tuning the surrounding architectural recipe than the sheaf operator itself.
