Search papers, labs, and topics across Lattice.
This study reproduces and extends the findings of Mattos et al. (2025), demonstrating that demographic parity ($螖_\mathrm{DP}$) fails to capture exposure bias in ranked link prediction, as it can indicate aggregate fairness while masking systematic ranking disparities among subgroup-pair links. The authors introduce the rank-aware Normalized Discounted KL-divergence (NDKL), which effectively identifies these disparities, and validate the MORAL post-processing method that enhances exposure-based fairness while preserving competitive utility. Through rigorous testing across various settings and metrics, the study reveals that exposure-based metrics can uncover biases overlooked by $螖_\mathrm{DP}$, and MORAL significantly mitigates these biases with minimal impact on performance.
Exposure-based fairness metrics reveal hidden biases that demographic parity overlooks, challenging conventional fairness assessments in link prediction.
In fair ranked link prediction, demographic parity ($螖_\mathrm{DP}$) is a common fairness metric. Yet, Mattos et al. (2025) argue that it fails to detect exposure bias because it ignores where links appear in the ranking. In this study, we reproduce this claim by showing that $螖_\mathrm{DP}$ can indicate aggregate parity even when some subgroup-pair links are systematically ranked lower than others. The proposed rank-aware Normalized Discounted KL-divergence (NDKL), however, does detect such disparities. We also reproduce the effectiveness of MORAL, a post-processing method that improves exposure-based fairness while maintaining competitive utility. Beyond reproduction, we assess robustness using synthetic homophily settings, categorical sensitive attributes, and additional fairness and utility metrics, including subgroup-pair-adapted Attention-Weighted Rank Fairness (AWRF). Overall, our results show that exposure-based metrics uncover biases hidden by $螖_\mathrm{DP}$ and that MORAL reduces these biases with minimal utility loss across diverse settings and datasets. We release a corrected, reproducible implementation at https://github.com/Floris93100/reproducing-MORAL.
