Search papers, labs, and topics across Lattice.
This paper introduces the Explainable Control Framework (XCF), which provides model-agnostic explanations for controllers in closed-loop systems, enhancing human understanding of complex control mechanisms. The framework employs a novel hierarchical fuzzy model-agnostic explanation method (HFMAE-C) that uses fuzzy logic to generate detailed explanations of controller behavior through IF-THEN rules, quantifying the impact of system states on control actions. Case studies demonstrate that XCF outperforms existing explainable control methods, offering significant insights into controller decision-making processes.
XCF reveals the decision logic of complex controllers, making their behavior interpretable through human-friendly explanations and interactive consultations.
Increasing demand for precise and reliable control in complex scenarios has led to the development of increasingly sophisticated controllers, including data-driven approaches employing closed box models and mathematically rigorous yet complex designs. This complexity highlights the needs for explainable control that can provide human-understandable insights into controller behavior. In this paper, an explainable control framework (XCF) along with supporting algorithms and user interface are proposed to explain how controllers determine their control actions and their underlying working mechanism. The novel contributions of this work are threefold: First, the XCF is designed to provide model-agnostic explanations for controllers in closed-loop systems and can optionally refine local explanations by system response dynamics. Second, a novel explanation method, hierarchical fuzzy model-agnostic explanation for control systems (HFMAE-C), is proposed based on the designed framework. The HFMAE-C employs a fuzzy logic system to approximate the controller's behavior and system dynamics, providing sample, local, domain and universe level explanations via IF-THEN rules revealing the controller's decision logic and salience values quantifying the contribution of system states to control actions. Third, a large language model agent-supported user interface is developed to automatically analyze user requirements, select appropriate algorithms, interpret the generated explanations to a natural language report, and provide interactive consultation. Case studies on inverted pendulum system and Turtlebot obstacle avoidance demonstrate the effectiveness of the proposed method through simulated user experiments and quantitative comparisons with mainstream explainable control approaches.
