Search papers, labs, and topics across Lattice.
This paper introduces a deep reinforcement learning (DRL) framework for maritime coverage path planning (CPP) on irregular hexagonal grids, using a Transformer-based pointer policy to autoregressively construct coverage tours. To address instability in value estimation for long-horizon routing, the authors employ a critic-free Group-Relative Policy Optimization (GRPO) scheme, estimating advantages through within-instance trajectory comparisons. Experiments on synthetic maritime environments demonstrate that the trained policy significantly outperforms heuristic baselines in Hamiltonian success rate (99.0% vs 46.0%), path length (7% shorter), and heading changes (24% fewer), while maintaining real-time inference speeds.
Ditch the critic: a novel critic-free DRL approach more than doubles the success rate of maritime coverage path planning compared to heuristics, while also generating shorter, smoother paths.
Maritime surveillance missions, such as search and rescue and environmental monitoring, rely on the efficient allocation of sensing assets over vast and geometrically complex areas. Traditional Coverage Path Planning (CPP) approaches depend on decomposition techniques that struggle with irregular coastlines, islands, and exclusion zones, or require computationally expensive re-planning for every instance. We propose a Deep Reinforcement Learning (DRL) framework to solve CPP on hexagonal grid representations of irregular maritime areas. Unlike conventional methods, we formulate the problem as a neural combinatorial optimization task where a Transformer-based pointer policy autoregressively constructs coverage tours. To overcome the instability of value estimation in long-horizon routing problems, we implement a critic-free Group-Relative Policy Optimization (GRPO) scheme. This method estimates advantages through within-instance comparisons of sampled trajectories rather than relying on a value function. Experiments on 1,000 unseen synthetic maritime environments demonstrate that a trained policy achieves a 99.0% Hamiltonian success rate, more than double the best heuristic (46.0%), while producing paths 7% shorter and with 24% fewer heading changes than the closest baseline. All three inference modes (greedy, stochastic sampling, and sampling with 2-opt refinement) operate under 50~ms per instance on a laptop GPU, confirming feasibility for real-time on-board deployment.
