Search papers, labs, and topics across Lattice.
This paper addresses the problem of learning optimal selective disclosure policies for revealing support information to human decision-makers under a budget constraint. The authors derive an optimal threshold policy based on the Value of Information (VoI) and propose a practical plug-in approach to estimate VoI and bound policy degradation and regret. Experimental results demonstrate that selective disclosure significantly outperforms both no and full disclosure, with user studies confirming improved human-AI team performance when disclosure is policy-led.
Humans make better decisions when AI selectively reveals information, but only if the AI learns *when* to reveal it, outperforming both full disclosure and no disclosure.
In many high-stakes settings, human decision-makers can acquire support information before making a decision. However, acquiring information is costly, and disclosure may fail to improve human decisions or may even impair them. We tackle this problem by studying selective disclosure, i.e., the problem of learning when to reveal support information to a human decision-maker under a budget constraint. We first show that the optimal policy is a threshold rule on the Value of Information (VoI), i.e., the expected reduction in human decision risk induced by disclosure. Since VoI is unknown in practice, we estimate the regime-specific human risks and bound the possible degradation of the resulting plug-in policy relative to lack of disclosure, as well as its regret relative to the optimal policy. Experiments on benchmark datasets show that selective disclosure outperforms both no disclosure and full disclosure, regardless of whether the support information is beneficial or harmful. Two user studies show that human-AI team performance can improve when disclosure is led by our learned policy and not human-selected, although this advantage varies across tasks. A counterfactual benchmark, which replaces participants' predictions with a machine-learning prediction when disclosure occurs, suggests that these differences might depend on lower adherence to advice when the information is automatically provided rather than self-requested.