Search papers, labs, and topics across Lattice.
This paper addresses the practical limitations of risk-averse machine learning by proposing a novel approach that explicitly models epistemic uncertainty in loss distributions using credal sets. By combining a credal set-based learner with a decision rule optimized for CVaR minimization, the method reliably avoids worst-case scenarios across diverse tasks like classification, distribution shift, and reinforcement learning. The key result demonstrates that this credal machine learning framework achieves robust risk aversion with minimal degradation in expected performance.
Uncertainty in loss distributions cripples standard risk-averse ML; this work shows credal sets can reliably prevent catastrophic decisions without sacrificing average performance.
In many machine learning applications, it is necessary to guard against worst-case scenarios and predictions that could result in substantial losses. In principle, this can be achieved by training risk-averse predictive models that minimize loss functions such as conditional value-at-risk (CVaR), rather than relying on models that perform well on average. In practice, however, the effectiveness of this approach to risk aversion is undermined by the learner's uncertainty regarding the true loss distribution and, consequently, the true CVaR. To achieve reliable risk-aversion, we propose a method in which this (epistemic) uncertainty is represented in terms of credal sets, i.e., sets of probability distributions. More specifically, we develop an efficient yet reliable learner that produces predictions in the form of credal sets and combine it with a novel decision rule that maps each credal set to a single predictive distribution for CVaR minimization. Across classification, under distribution shift, and in reinforcement learning, our approach reliably avoids catastrophic decisions, while sacrificing little in expected performance.