Search papers, labs, and topics across Lattice.
This paper addresses multi-objective learning in non-stationary online settings, where the goal is to satisfy multiple objectives simultaneously, such as calibration and multiaccuracy. The authors propose a novel approach that integrates an adaptive online algorithm into the multi-objective learning framework to achieve local adaptivity to distribution shifts. Empirical results on energy forecasting and algorithmic fairness datasets demonstrate that the proposed method outperforms existing approaches by achieving unbiased predictions over subgroups and maintaining robustness under distribution shift.
Forget global worst-case guarantees – this new multi-objective learning method actually adapts to distribution shifts and delivers unbiased predictions in dynamic environments.
We consider the general problem of learning a predictor that satisfies multiple objectives of interest simultaneously, a broad framework that captures a range of specific learning goals including calibration, regret, and multiaccuracy. We work in an online setting where the data distribution can change arbitrarily over time. Existing approaches to this problem aim to minimize the set of objectives over the entire time horizon in a worst-case sense, and in practice they do not necessarily adapt to distribution shifts. Earlier work has aimed to alleviate this problem by incorporating additional objectives that target local guarantees over contiguous subintervals. Empirical evaluation of these proposals is, however, scarce. In this article, we consider an alternative procedure that achieves local adaptivity by replacing one part of the multi-objective learning method with an adaptive online algorithm. Empirical evaluations on datasets from energy forecasting and algorithmic fairness show that our proposed method improves upon existing approaches and achieves unbiased predictions over subgroups, while remaining robust under distribution shift.
BAIR