Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Lethe, the first comprehensive benchmark for evaluating Edge Unlearning (EU) in Graph Neural Networks, addressing limitations of existing evaluations that use feature-rich datasets and inaccurate proxy metrics. Lethe employs large graphs and link inference attacks to rigorously assess EU methods, revealing that current techniques can be slower than retraining and that accuracy metrics are insufficient due to the subtle impact of edge removal. The benchmark includes 15 EU methods and 8 datasets, providing a reproducible framework for future research in this critical area.
Existing benchmarks fail to accurately measure edge unlearning effectiveness, with current methods often slower than retraining and standard accuracy metrics proving misleading.
Graph Unlearning (GU) aims to remove the influence of specific training data from a Graph Neural Network without retraining anew. While most methods address removal of nodes and features, Edge Unlearning (EU), aiming at forgetting edges, has recently attracted dedicated attention as a standalone problem due to the hardness of completely removing the impact of an edge in the model. Despite this, no dedicated benchmark for EU exists besides isolated evaluations on feature-rich datasets such as Cora and Citeseer where GNNs exploit node features rather than graph structure. As such, we show two systematic limitations in existing evaluations: dedicated EU methods can be slower than retraining anew, and accuracy metrics are uninformative due to the negligible impact of edge removal. To address this gap, we introduce Lethe, the first comprehensive benchmark for Edge Unlearning, featuring 15 methods and 8 datasets. Our benchmark emphasizes large graphs, introduces evaluation tasks of varying difficulty, and proposes empirical measures based on link inference attacks rather than proxy accuracy metrics. We provide a comprehensive empirical analysis, demonstrate the shortcomings of current evaluations, and release Lethe as a reproducible, extensible benchmark.