Search papers, labs, and topics across Lattice.
This paper evaluates the effectiveness of the Greedy K-center method for diversity-based active learning across various metric spaces, including raw feature space, Linear Discriminant Analysis (LDA) space, and a model-derived probability space. The authors find that utilizing a predictive probability space with entropy-based weighting significantly enhances the selection process for informative samples, outperforming other approaches. These findings underscore the importance of metric space choice in optimizing active learning strategies, particularly in scenarios with limited labeled data.
Mapping unlabeled data into a predictive probability space with entropy weighting can dramatically improve active learning efficiency, surpassing traditional methods.
With rapid advancement over the last few years, many different methods are now widely used for classification. However, training these models requires substantial labeled data. Active Learning is a potential solution to this problem. Pool-based active learning minimizes costs by querying only the most informative samples from an unlabeled dataset. Diversity-based approaches, on the other hand, attempt to select a representative subset of the data. There are many different objectives for determining the selection process, including exact K-center, exact K-median, and Greedy K-center. In this paper, we will focus on evaluating the performance of Greedy K-center across a variety of metric spaces: the raw feature space, a Linear Discriminant Analysis (LDA) space, and a model-derived probability space (with and without entropy-based weighting). Using Random Forest classifiers as a baseline evaluator, our empirical results on synthetic and real-world datasets demonstrate that mapping unlabeled instances into a predictive probability space and weighting the result by entropy often dominates the other options for active learning selection with Greedy K-center.
