Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces an anticipatory risk-guided reinforcement learning framework designed to enhance safe quadrotor navigation in dynamic and cluttered environments. By constructing a future collision risk map based on the Closest Point of Approach (CPA) and employing an asymmetric actor-critic architecture, the method effectively predicts and incorporates collision risks into the visual policy during deployment. Experimental results show significant improvements in safety margins and flight efficiency, with successful zero-shot transfer from simulation to real-world applications, demonstrating the framework's robustness and generalization capabilities.
Anticipatory risk-guided reinforcement learning enables quadrotors to navigate complex environments with unprecedented safety and efficiency, even in real-world scenarios.
Safe quadrotor navigation in cluttered and dynamic environments depends not only on instantaneous geometric perception, but more critically on anticipating collision risks induced by relative motion. Conventional modular pipelines frequently suffer from perception latency, while end-to-end learning methods relying on implicit scalar rewards often struggle to extract reliable spatio-temporal features without physics-grounded supervision. To address this, we propose an anticipatory risk-guided reinforcement learning framework. Leveraging privileged simulator states, we construct a directionally aligned future collision risk map based on the Closest Point of Approach (CPA). Through an asymmetric actor-critic architecture, the network is trained to self-predict this structured risk, which explicitly guides the visual policy during deployment. A lightweight spatio-temporal encoder extracts motion cues directly from onboard depth sequences, bypassing explicit object tracking or optical flow estimation. Extensive simulated and real-world experiments demonstrate that our method effectively improves safety margins and flight efficiency in dense dynamic clutters compared to existing baselines. Furthermore, the learned policy achieves robust zero-shot Sim-to-Real transfer on a physical quadrotor, relying purely on abstracted spatio-temporal depth sequences and its self-predicted risk priors, validating the effectiveness of our approach and its robust generalization from simulation to reality.