Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ROBIN, a novel method for localizing and repairing bias in transformer attention heads by utilizing sensitivity to fairness probes. The study demonstrates that targeted interventions can effectively reduce bias, as evidenced by a significant reduction in the WinoBias gap across multiple models while maintaining language-modeling quality. These findings highlight the importance of both selecting the right attention heads and the specific modifications applied to them for effective bias mitigation.
Targeted interventions on transformer attention heads can significantly reduce bias without sacrificing language quality, challenging traditional approaches to fairness in AI models.
Transformer language models are increasingly used as software components, yet biased outputs remain difficult to localize and repair inside the model. Existing fairness testing and repair methods largely operate at the input-output or retraining level, while recent work suggests that bias-related behavior can concentrate in a small set of attention heads. This paper studies whether attention heads can be localized and repaired through a targeted inference-time intervention. We introduce ROBIN, a white-box head-level fairness debugging method that ranks attention heads using sensitivity to fairness probes and removes a small bias subspace from selected head outputs. In a four-model pilot study, ROBIN reduces the measured WinoBias gap across all models while preserving language-modeling quality better than whole-head zeroing. These preliminary results suggest that head-level bias repair should consider not only which heads are selected, but also how selected heads are modified.