Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the interpretability challenges of Deep Reinforcement Learning (DRL) in safety-critical applications by implementing a policy distillation framework that converts a high-performance TD3 agent into a more interpretable decision tree model. By employing a custom physics-aware feature and "Noisy Oracle Rollouts" for dataset generation, the distilled model retains performance comparable to the original teacher while enhancing transparency. The study reveals a critical trade-off between continuous and discrete control methods, highlighting the implications for stability and interpretability in autonomous systems.
Achieving high-performance DRL interpretability with a decision tree model that matches the efficacy of a complex TD3 agent could revolutionize trust in autonomous systems.
In safety-critical sectors such as robotics and automotive engineering, the deployment of Deep Reinforcement Learning (DRL) is often hindered by the black-box nature of deep neural networks. This lack of transparency poses significant challenges for regulatory compliance and human-agent trust. This paper presents an experimental study aimed at making high-performance continuous control DRL systems interpretable. A policy distillation framework is implemented using the classic Inverted Pendulum benchmark. A high-performance Twin Delayed DDPG (TD3) agent serves as an opaque, continuous teacher model, whose policy is distilled into an interpretable student surrogate based on a shallow Decision Tree. By leveraging a custom physics-aware feature and "Noisy Oracle Rollouts" for dataset generation, the distillation process achieves performance equivalent to the expert teacher. Furthermore, comparative control theory analysis reveals a fundamental trade-off: transitioning from continuous to discrete rule-based control induces high-frequency Bang-Bang actuation and a stable bimodal limit cycle. Simulation results indicate that Bounded-Input Bounded-Output (BIBO) stability is maintained while providing both global and local interpretability for safe autonomous systems.