Search papers, labs, and topics across Lattice.
The paper introduces the 2-Step Agent, a computational framework that models the impact of AI-provided predictions on human decision-making using Bayesian causal inference. This framework simulates how AI predictions influence a rational Bayesian agent's beliefs and subsequent decisions, ultimately affecting outcomes. Through simulations, the authors demonstrate that even a single misaligned prior belief can lead to suboptimal outcomes when using AI decision support, compared to scenarios without such support.
AI decision support can backfire and lead to worse outcomes than no support at all, even with rational users, if there's a mismatch in prior beliefs.
Across a growing number of fields, human decision making is supported by predictions from AI models. However, we still lack a deep understanding of the effects of adoption of these technologies. In this paper, we introduce a general computational framework, the 2-Step Agent, which models the effects of AI-assisted decision making. Our framework uses Bayesian methods for causal inference to model 1) how a prediction on a new observation affects the beliefs of a rational Bayesian agent, and 2) how this change in beliefs affects the downstream decision and subsequent outcome. Using this framework, we show by simulations how a single misaligned prior belief can be sufficient for decision support to result in worse downstream outcomes compared to no decision support. Our results reveal several potential pitfalls of AI-driven decision support and highlight the need for thorough model documentation and proper user training.
