Search papers, labs, and topics across Lattice.
This paper introduces QueryMarket, a novel framework for online active learning that integrates data pricing, information gain, and budget constraints in dynamic environments. The core method, OVBAL, employs a D-optimality criterion with exponential forgetting to estimate the marginal utility of incoming data points, enabling cost-aware decision-making in real-time. Experimental results demonstrate that OVBAL significantly improves long-run error-cost trade-offs, particularly in scenarios with seller-centric pricing, making it a valuable approach for real-world applications like solar power forecasting.
OVBAL achieves a superior balance between cost and learning efficiency, adapting seamlessly to nonstationary data streams and heterogeneous pricing.
Data acquisition is a major bottleneck for learning in real-time streams: analysts must decide on the fly which labels to purchase while respecting a rolling budget. However, existing online active learning rarely unifies pricing, information gain, and rolling budget constraints under concept drift. We introduce QueryMarket, a market-inspired framework that queries each incoming data point based on its estimated utility to the model and its price. Within this framework, we propose OVBAL (online variance-based active learning), which integrates data pricing with information-driven selection by estimating each sample's marginal utility via a D-optimality criterion with exponential forgetting and executing cost-aware purchases under rolling budget constraints. OVBAL yields a simple, fully online decision rule that adapts to nonstationary streams and heterogeneous label costs. Experiments on synthetic data and a real-world solar power generation forecasting task show that OVBAL is particularly effective under seller-centric pricing and yields a more favorable long-run error-cost trade-off in the real-world task under both pricing schemes.
