Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Socio-Contrastive Learning, a novel method for modeling annotator perspectives by jointly learning socio-demographic representations. It addresses the limitation of prior work by incorporating finer-grained socio-demographic attributes to better explain human perspectives in NLP tasks with annotation disagreement. Experiments demonstrate that Socio-Contrastive Learning outperforms concatenation-based methods in predicting annotator perspectives and enables the analysis of how demographic factors influence these perspectives.
Forget simply concatenating demographics – Socio-Contrastive Learning reveals how to fuse socio-demographic features and textual representations to better predict and understand diverse annotator perspectives.
Humans often hold different perspectives on the same issues. In many NLP tasks, annotation disagreement can reflect valid subjective perspectives. Modeling annotator perspectives and understanding their relationship with other human factors, such as socio-demographic attributes, have received increasing attention. Prior work typically focuses on single demographic factors or limited combinations. However, in real-world settings, annotator perspectives are shaped by complex social contexts, and finer-grained socio-demographic attributes can better explain human perspectives. In this work, we propose Socio-Contrastive Learning, a method that jointly models annotator perspectives while learning socio-demographic representations. Our method provides an effective approach for the fusion of socio-demographic features and textual representations to predict annotator perspectives, outperforming standard concatenation-based methods. The learned representations further enable analysis and visualization of how demographic factors relate to variation in annotator perspectives. Our code is available at GitHub: https://github.com/Leixin-Zhang/Socio_Contrastive_Learning