Search papers, labs, and topics across Lattice.
This paper introduces a reinforcement learning framework for autonomous navigation of Unmanned Surface Vehicles (USVs) that explicitly addresses uncertainty in perception and compliance with maritime regulations. The framework incorporates credibility-weighted value learning to mitigate the impact of noisy state estimates, a geometric safety shield based on covariance-inflated velocity obstacles, and a continuous rule-aware embedding of COLREGs duties. Simulation results demonstrate improved robustness against perceptual inconsistency and superior collision avoidance compared to baseline RL methods.
By dynamically weighting RL updates based on the credibility of state estimates, this approach enables safer and more reliable autonomous navigation for USVs in uncertain environments.
Autonomous navigation of Unmanned Surface Vehicles (USVs) that is safe and compliant with the International Regulations for Preventing Collisions at Sea (COLREGs) remains a formidable challenge in dynamic maritime environments, particularly when perception systems exhibit miscalibrated uncertainty. Existing Reinforcement Learning (RL)-based methods often falter because state-estimation errors induce unreliable belief states that mislead the value function, while discrete traffic rules introduce discontinuity in the learning objective. To address these challenges, we propose a framework integrating credibility-aware learning, geometric safety shielding, and continuous rule-aware embedding. First, Credibility-Weighted Value Learning (CW-VL) introduces a dynamic trust factor derived from the discrepancy between filter-estimated covariance and empirical error statistics to modulate the critic's heteroscedastic loss, preventing policy overfitting to noisy samples. Second, the Covariance-Inflated Velocity Obstacle (CI-VO) maps position-estimation uncertainty into set-wise angular margins, forming a conservative geometric shield that overrides hazardous exploratory actions. Third, Risk-Aware COLREGs Duty Embedding relaxes binary encounter duties into continuous rule-aware signals, providing smooth sector-transition information and suppressing oscillation from sparse rule rewards. Simulated encounter studies demonstrate improved training robustness against perceptual inconsistency and superior collision avoidance and COLREGs compliance over baselines.
