Search papers, labs, and topics across Lattice.
This paper introduces a multi-agent LLM architecture designed to facilitate interactive explanations in automated planning systems, enabling users to guide the AI planner based on their preferences and expertise. The framework is agnostic to the specific explanation type and allows for user- and context-dependent interactions. A user study comparing the LLM-powered interaction with a template-based baseline for goal-conflict explanations demonstrates the potential of the approach.
LLMs can power interactive explanations in AI planning, letting users explore the plan space through natural language and improving trust compared to template-based approaches.
When automating plan generation for a real-world sequential decision problem, the goal is often not to replace the human planner, but to facilitate an iterative reasoning and elicitation process, where the human's role is to guide the AI planner according to their preferences and expertise. In this context, explanations that respond to users'questions are crucial to improve their understanding of potential solutions and increase their trust in the system. To enable natural interaction with such a system, we present a multi-agent Large Language Model (LLM) architecture that is agnostic to the explanation framework and enables user- and context-dependent interactive explanations. We also describe an instantiation of this framework for goal-conflict explanations, which we use to conduct a user study comparing the LLM-powered interaction with a baseline template-based explanation interface.
