Search papers, labs, and topics across Lattice.
This paper introduces AutoSafe, a novel safety-aware policy architecture designed for safe online reinforcement learning that balances safety constraints with smooth optimization dynamics. By integrating structured safety monitoring and intervention into the action generation process, AutoSafe allows for seamless transitions between performance-driven and safety-preserving behaviors. Empirical evaluations across continuous-control benchmarks and a physical cart-pole system show that AutoSafe achieves robust safety enforcement while maintaining smooth learning dynamics, addressing the limitations of existing methods.
AutoSafe enables seamless integration of safety and performance in online reinforcement learning, achieving robust safety without sacrificing learning smoothness.
Safe online reinforcement learning requires policies to respect safety constraints while maintaining smooth optimization dynamics. Existing approaches typically rely on either strict safety enforcement via action interventions, which introduce discontinuities in system interaction and learning, or soft safety constraint formulations, which preserve smooth learning but provide limited safety assurance. We propose AutoSafe, a safety-aware policy architecture that integrates structured safety monitoring and intervention directly into the action generation process. This design enables smooth, risk-dependent transitions between performance-driven and safety-preserving behaviors, resulting in continuous online interaction and learning dynamics. Empirical results across a suite of continuous-control benchmarks demonstrate strong safety enforcement without sacrificing learning smoothness. We further validate AutoSafe on a physical cart-pole system, highlighting its practical effectiveness for safe online learning in the real world.
