Search papers, labs, and topics across Lattice.
The paper introduces Wilson Score Kernel Density Classification (WSKDC), a kernel-based method for estimating reliable confidence bounds in binary classification, crucial for automating critical inspection tasks. WSKDC leverages a Wilson Score Kernel Density Estimator to estimate confidence bounds in Binomial experiments with varying success probabilities. Experiments on four datasets demonstrate WSKDC's competitive performance compared to Gaussian Process Classification, but with reduced computational cost, making it suitable as a classification head for various feature extractors, including vision foundation models.
Achieve Gaussian Process-level confidence bounds in binary classification with a fraction of the computational cost using Wilson Score Kernel Density Estimation.
The performance and ease of use of deep learning-based binary classifiers have improved significantly in recent years. This has opened up the potential for automating critical inspection tasks, which have traditionally only been trusted to be done manually. However, the application of binary classifiers in critical operations depends on the estimation of reliable confidence bounds such that system performance can be ensured up to a given statistical significance. We present Wilson Score Kernel Density Classification, which is a novel kernel-based method for estimating confidence bounds in binary classification. The core of our method is the Wilson Score Kernel Density Estimator, which is a function estimator for estimating confidence bounds in Binomial experiments with conditionally varying success probabilities. Our method is evaluated in the context of selective classification on four different datasets, illustrating its use as a classification head of any feature extractor, including vision foundation models. Our proposed method shows similar performance to Gaussian Process Classification, but at a lower computational complexity.