Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper simplifies Evidential Deep Learning (EDL) by approximating the Dirichlet expected objective with a plug-in loss evaluated at the Dirichlet mean, reducing computational complexity. The authors prove that the approximation error decays with growing evidence under mild assumptions for common loss functions like MSE and cross-entropy. They demonstrate on the Google Speech Commands dataset that the simplified objectives achieve comparable performance to classical EDL in predictive accuracy and selective prediction, while being easier to implement.
Softmax classifiers, when viewed through the lens of Evidential Deep Learning, can provide uncertainty estimates comparable to more complex EDL methods, simplifying uncertainty-aware deep learning.
Real-world sensor-based learning systems require uncertainty estimation that is both reliable and computationally efficient. Evidential Deep Learning (EDL) provides single-pass uncertainty estimation by modeling the class probabilities via Dirichlet distributions, where the Dirichlet parameters are predicted by a learned neural network mapping. However, this approach can lead to computational challenges, as Dirichlet expected objectives are more complex than standard supervised learning losses, complicating their analysis and implementation. We address this issue by approximating the objective of the first-order empirical risk minimization problem induced by EDL with a plug-in loss evaluated at the Dirichlet mean and show that, under mild assumptions, the approximation error decays with growing evidence for a broad class of loss functions, including mean-squared error and cross-entropy loss. As a special case, our analysis provides justification for the use of softmax in the context of uncertainty estimation, since under a particular evidence-to-Dirichlet mapping, our framework includes the standard softmax classifier. We validate the proposed simplified objectives on the Google Speech Commands dataset and show that they achieve predictive accuracy and selective prediction performance comparable to classical EDL, while being simpler to implement using standard deep learning losses and training pipelines. To the best of our knowledge, this empirical analysis is the first to obtain coverage-accuracy trade-offs for speech recognition tasks through EDL.
TU Munich