Search papers, labs, and topics across Lattice.
This paper introduces a novel framework that integrates Control Barrier Functions (CBFs) into Inverse Reinforcement Learning (IRL) to ensure safe exploration from expert demonstrations. By constraining the reward function to the space of CBFs, the authors achieve safe online control while allowing for continuous experiential improvement, even recovering barrier functions from unlabeled expert observations. The proposed method outperforms standard IRL baselines in simulated navigation tasks, demonstrating enhanced safety performance and robustness against unsafe states not present in the expert data.
Safety in adversarial imitation learning can be achieved by leveraging Control Barrier Functions, leading to improved robustness against unseen unsafe states.
Inverse Reinforcement Learning (IRL) algorithms are powerful tools for learning from and generalizing expert demonstrations, but they often rely on unconstrained exploration, rendering them unsafe for real-world deployment. Meanwhile, Control Barrier Functions (CBFs) can guarantee the safety of control systems, but the analytical design of CBFs can be time-consuming and esoteric. In this work, we address these limitations jointly by constraining reward function candidacy during IRL to the space of CBFs, yielding a formulation that exhibits safe online control with continuous experiential improvement. Crucially, this framework enables the data-driven recovery of barrier functions directly from unlabeled expert observations. We demonstrate that the recovered barrier function is robust to unsafe states entirely absent from the expert data. Furthermore, we benchmark our method against standard IRL baselines in a simulated navigation environment, demonstrating improved safety performance. Finally, we investigate the trade-offs of planning-based versus policy-based IRL methods across both simulation and a real world obstacle avoidance task.
UW