Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores the integration of large language models (LLMs) into multi-agent systems (MAS) for actuarial risk modeling, emphasizing the quantification of uncertainty in high-stakes decision-making contexts. By leveraging a framework where specialized agents handle various tasks under a central hub, the authors propose a novel method for uncertainty propagation that utilizes token-level log-probabilities transformed into calibrated confidence estimates within a Bayesian Network. The results indicate that this approach not only maintains baseline actuarial performance but also enhances insights into workflow stability and uncertainty management during runtime.
Uncertainty in LLM outputs can be effectively quantified and managed in multi-agent actuarial systems, leading to more reliable risk assessments.
This paper investigates how multi-agent systems (MAS)-based on large language models (LLMs) can support actuarial risk modelling, with a particular focus on uncertainty quantification. Actuarial workflows represent a high-stakes decision-support setting where unreliable outputs may lead to incorrect risk assessment, unfair pricing, and regulatory non-compliance. To address uncertainty introduced by the probabilistic nature of LLMs and dependencies between agents, a multi-agent framework is proposed in which specialised agents perform data preparation, modelling, review, and explanation tasks under a central hub. The main contribution is a novel approach to uncertainty propagation using token-level log-probabilities and a Bayesian Network. Importantly, log probabilities are not treated as direct probabilities of correctness or task success. Instead, length-normalised log-probability summaries are transformed into calibrated task-level confidence estimates before incorporation into the Bayesian Network. Results show that the framework reproduces baseline actuarial performance while providing additional insight into workflow stability and runtime uncertainty propagation.