Search papers, labs, and topics across Lattice.
This paper extends the dtControl2 framework by introducing an "$\varepsilon$" functionality that allows for the construction of smaller decision trees while maintaining $\varepsilon$-optimality in Markov decision processes. By allowing a controlled level of imprecision, the authors demonstrate that it is possible to distill complex controllers into more human-comprehensible representations without sacrificing performance. The resulting decision trees are significantly smaller than existing state-of-the-art solutions, enhancing explainability in large systems with numerous corner cases.
Smaller decision trees can maintain optimality while providing clearer, more understandable explanations for complex decision-making processes.
Over the past decade, decision trees have been used to represent controllers (a.k.a. policies) in an explainable way, with dtControl2 as a current state-of-the-art tool. However, for systems that are large or have many corner cases, even such representations tend to be too complex and not human-comprehensible. Unfortunately, reducing the size of the decision tree is not straightforward, as missing just a single crucial case might result in an incorrect controller. We tackle this issue in the setting of Markov decision processes, extending dtControl2 by "$\varepsilon$" functionality: Given an allowed imprecision $\varepsilon \geq 0$, we construct a smaller decision tree, distilling the essence of the controller, while still guaranteeing its $\varepsilon$-optimality. This enables us to provide tunably simpler explanations, omitting a controllable amount of detail. Our tool constructs decision trees that are orders of magnitude smaller than the state of the art.
