Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel approach to Inverse Reinforcement Learning (IRL) by constraining the reward function to the space of Control Barrier Functions (CBFs), ensuring safe exploration during learning from expert demonstrations. The method not only allows for the data-driven recovery of barrier functions from unlabeled observations but also shows robustness against unsafe states not present in the expert data. Benchmarking against standard IRL baselines reveals significant improvements in safety performance, particularly in simulated navigation and real-world obstacle avoidance tasks.
By constraining reward functions to Control Barrier Functions, this approach achieves safe adversarial imitation learning that adapts directly from expert observations without requiring labeled data.
Inverse Reinforcement Learning (IRL) algorithms are powerful tools for learning from and generalizing expert demonstrations, but they often rely on unconstrained exploration, rendering them unsafe for real-world deployment. Meanwhile, Control Barrier Functions (CBFs) can guarantee the safety of control systems, but the analytical design of CBFs can be time-consuming and esoteric. In this work, we address these limitations jointly by constraining reward function candidacy during IRL to the space of CBFs, yielding a formulation that exhibits safe online control with continuous experiential improvement. Crucially, this framework enables the data-driven recovery of barrier functions directly from unlabeled expert observations. We demonstrate that the recovered barrier function is robust to unsafe states entirely absent from the expert data. Furthermore, we benchmark our method against standard IRL baselines in a simulated navigation environment, demonstrating improved safety performance. Finally, we investigate the trade-offs of planning-based versus policy-based IRL methods across both simulation and a real world obstacle avoidance task.