Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of costly human labeling by proposing stochastic first- and zeroth-order optimization methods for training models on datasets containing both ground-truth and ML-generated labels. The core idea is to leverage imperfect ML labels to augment scarce human annotations, enabling scalable training. Empirical results demonstrate the effectiveness of these methods across tasks ranging from linear regression to LLM fine-tuning.
Training LLMs and other models is feasible and effective using a mix of human-annotated and ML-generated labels, bypassing the bottleneck of full human annotation.
Training a machine learning (ML) model is an optimization process that typically requires a set of examples with ground-truth labels beforehand. Obtaining these ground truths usually requires laborious human effort and can be costly. The scalability of human labeling becomes a concern when there are a large number of data points that need to be labeled. To address this practical issue, we consider an optimization setting where a subset of samples has ground-truth labels, while the remaining data points were labeled by an ML predictor, which could potentially assign incorrect labels to those points. We propose both first-order and zeroth-order stochastic optimization methods for training on datasets consisting of a mix of true-labeled and ML-labeled samples. We further conduct comprehensive empirical studies from training a linear regression model to fine-tuning a large language model (LLM) to showcase the effectiveness of the proposed algorithms for training with ML-labeled data.