Search papers, labs, and topics across Lattice.
This paper addresses the challenge of evaluating Lipschitz-style individual fairness in multi-task learning (MTL) by identifying the issue of threshold confounding, which arises when different algorithms are assessed under varying semantic thresholds. The authors introduce ReLiF, a reliability-aware framework that decouples evaluation-time fixed-$δ$ auditing from training-time regularization, allowing for consistent comparisons across models. Experiments demonstrate that ReLiF not only achieves competitive utility on clinical time-series benchmarks and NYUv2 but also effectively reduces aligned bias under shared fixed thresholds, highlighting the importance of fixed-$δ$ auditing in revealing utility-fairness trade-offs obscured by method-dependent thresholds.
Fixed-$δ$ auditing reveals that method-dependent thresholds can obscure critical utility-fairness trade-offs in multi-task learning.
Lipschitz-style individual fairness formalizes the idea that semantically similar examples should receive similar predictions, but its evaluation in multi-task learning (MTL) can be confounded by method-induced representation scales. This paper identifies threshold confounding: when the auditing tolerance is derived from each model's own representation distances, different algorithms are compared under different semantic thresholds. A threshold-drift analysis further shows how Bias rankings can change and identifies sufficient conditions for ranking preservation. We propose \textbf{ReLiF}, a reliability-aware framework that separates evaluation-time fixed-$δ$ auditing from training-time controlled regularization. ReLiF uses a shared reference tolerance for comparable auditing and a violation-rate feedback controller to keep the Lipschitz surrogate active without letting it dominate stochastic training. This work also develops supporting analysis for threshold drift, reference-tolerance selection, and the relationship between the huberized training surrogate and its unsmoothed positive-margin counterpart. Experiments on clinical time-series benchmarks and NYUv2 (NYU Depth V2) dense prediction show that fixed-$δ$ auditing exposes utility--fairness trade-offs that method-dependent thresholds can obscure. On NYUv2 with a ResNet50 backbone, ReLiF achieves competitive utility while substantially reducing aligned bias under shared fixed thresholds. On clinical benchmarks, ReLiF yields controlled fairness-regularized trade-offs, while fixed-$δ$ auditing reveals that task-balancing baselines can sometimes achieve lower bias and that genuine utility--fairness trade-offs persist. These results support fixed-$δ$ auditing as a semantically consistent protocol for evaluating Lipschitz fairness in MTL.
