Search papers, labs, and topics across Lattice.
This paper introduces a geometry-aware kernel density estimation (KDE) model for multiclass quantification that leverages log-ratio representations and Aitchison geometry to address the limitations of traditional KDE methods which misallocate probability mass outside the probability simplex. By incorporating a shrinkage regularization technique, the model enhances robustness near the simplex boundary, enabling more accurate estimation of class prevalences. Experimental results across 42 datasets demonstrate that this approach not only competes with state-of-the-art quantifiers but often surpasses standard KDE-based methods and performs well in Bayesian quantification contexts.
Geometry-aware methods can significantly enhance class prevalence estimation, correcting misallocated probability mass and improving robustness in quantification tasks.
Accurately estimating the unknown target label distribution is the critical first step for adapting to label shift. This task, widely known as quantification or class prevalence estimation, has recently seen significant advances through continuous KDE-based methods which model the density of multiclass classifier posteriors. Posterior vectors might be regarded as compositional data, since they lie on the probability simplex. However, existing KDE-based quantifiers typically rely on Euclidean Gaussian kernels, which ignore simplex geometry and incorrectly assign probability mass outside its boundaries. We introduce a geometry-aware KDE model for multiclass quantification based on log-ratio representations and Aitchison geometry, together with a shrinkage regularization that improves robustness near the simplex boundary. Combined with a maximum-likelihood interpretation of KDE-based quantification, we derive both point-estimation and Bayesian inference procedures for class prevalences. Experiments on 42 datasets across tabular, text, and image domains show that the proposed method is competitive with state-of-the-art quantifiers, often improving over standard KDE-based baselines, while also yielding strong results among Bayesian quantification methods.
