Search papers, labs, and topics across Lattice.
This paper explores uncertainty-aware decision-making algorithms grounded in Bayesian decision theory to enhance the performance of Large Language Models (LLMs) in tasks like tutoring and peer reviewing. By incorporating uncertainty in tutoring strategies and review scores, the authors demonstrate that these algorithms can significantly improve the utility of model outputs, although careful implementation is crucial in high-ambiguity scenarios. Key findings indicate that while risk-averse strategies may lead to generic outputs, Bayesian methods generally yield superior performance in maintaining quality and trustworthiness of the generated content.
Risk-averse decision-making can backfire, leading to generic outputs, while Bayesian methods enhance LLM performance in high-stakes tasks like tutoring and peer review.
With rapidly improving capabilities, Large Language Models (LLMs) are increasingly used in many complex real-world tasks. Beyond requiring in-depth knowledge and reasoning skills, many of these tasks exhibit a high degree of subjectivity and require that the outputs of the model can be trusted. While a lot of progress has been made to train better models, decision-making algorithms have received less attention. In this work, we present and evaluate various uncertainty-aware decision-making algorithms based on Bayesian decision theory and risk-averse decision making on the tasks of tutoring and automatic peer reviewing. Concretely, we take uncertainty over tutoring strategies and review scores into account when generating a tutor response or review and use conformal prediction to provide guarantees over strategy and score. We find empirically that these algorithms can improve the utility of the generations but need to be carefully implemented when ambiguity is high. For example, risk-averse rules can degrade performance by optimizing for generic outputs, while Bayesian methods tend to perform better. Our work uses techniques from decision theory to improve LLM-based decision-making and outlines open challenges for the community.
