Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
To address non-monotonicity in existing Bayesian uncertainty estimation for open-set recognition, the authors develop MPRisk, an uncertainty scoring metric that directly quantifies the decision risks of false acceptance, false rejection, and misidentification using a continuous unknown component. Standard methods like HolUE rely on KL-divergence summaries that fail to correlate monotonically with true decision risk and require brittle supervised nonlinear calibrators. Evaluated across nine vision, audio, and text benchmarks, MPRisk achieves state-of-the-art Prediction Rejection Ratio curves using just four linear validation weights, outperforming HolUE by up to +0.19 PRR at lower computational overhead.
Standard KL-divergence metrics for open-set uncertainty frequently correlate inversely with true decision error, but replacing them with a four-parameter direct decision risk formula outperforms complex nonlinear calibrators across vision, audio, and text benchmarks.
In open-set recognition (OSR), a probe must either be identified as one of the known gallery classes or rejected as unknown, so three error types coexist: false acceptance, false rejection, and misidentification. An uncertainty score for selective recognition should rank probes by the risk of the decision the system has made. Bayesian gallery-aware models such as Holistic Uncertainty Estimation (HolUE) summarize the posterior over known and unknown classes by Kullback--Leibler (KL) divergence components and map them to an uncertainty score with a supervised nonlinear calibrator. We show that the KL summary is not generally monotone in decision risk: linear fusion of the KL components tuned on validation data yields negative filtering quality on several benchmarks. We propose MPRisk, a mixed-prior posterior decision-risk score that keeps the same Bayesian posterior but directly scores the error events associated with the selected decision: false-acceptance, misidentification, and false-rejection risks, plus a non-specificity penalty for rejections, enabled by modeling unknown identities as a continuous component. Four nonnegative weights tuned on a validation set suffice for ranking; no nonlinear supervised model is required. Across nine image, audio, and text benchmarks, MPRisk achieves the best or tied-best Prediction Rejection Ratio at every operating point on the image and audio benchmarks and on most text operating points, with bootstrap-confirmed gains over HolUE on five benchmarks (up to $+0.19$ PRR) at comparable or lower runtime.