Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the semantic interpretability of disagreement in pairwise preference learning, distinguishing between stable latent heterogeneity, ephemeral stochasticity, and non-binary responses. The authors introduce a nonparametric latent semantic model with querywise aggregate directional preference ($μ_q$), persistent disagreement ($τ_q$), and non-binary mass ($α_q$), proving that only $μ_q$ is point-identified from anonymous binary feedback. Full identification of $(τ_q, α_q)$ is achieved through same-annotator repeats or abstention-enabled feedback, with theoretical guarantees and empirical validation on synthetic data.
Disagreement in pairwise preferences isn't just noise; it reveals distinct latent semantic structures, with only aggregate directional preference being truly identifiable from binary feedback alone.
Pairwise comparison data are a standard supervision signal in preference learning, but disagreement in such data can reflect stable latent heterogeneity, ephemeral stochasticity, or non-binary responses hidden by a forced-choice interface. We study which of these semantic distinctions are identifiable from the feedback channel itself. We introduce a nonparametric latent semantic model with three querywise quantities: aggregate directional preference $μ_q$, persistent disagreement $τ_q$, and non-binary mass $α_q$. Under the anonymous binary channel, we prove an exact semantic fiber theorem: $μ_q$ is point-identified, whereas $(τ_q, α_q)$ vary over an explicit feasible region compatible with the same binary law. Same-annotator repeats identify $τ_q$ through a covariance identity, abstention-enabled feedback identifies $α_q$ directly, and together they point-identify the full semantic triple. We also derive finite-sample estimators, nonasymptotic concentration bounds, and semantics-aware action-recovery guarantees, and validate the theory on theorem-matched synthetic data.