Search papers, labs, and topics across Lattice.
This paper introduces RL-Ballast, a graph-based deep reinforcement learning framework designed for adaptive ballast-water path planning and clog prediction in autonomous vessels. By transforming the valve-permutation problem into 54 feasible fluid-transfer routes and employing a novel approach to infer hidden blockages without extensive sensors, RL-Ballast significantly enhances operational safety and efficiency. Monte Carlo simulations demonstrate that RL-Ballast not only completes all unexpected single-blockage scenarios but also reduces decision-making steps by 32% compared to traditional rule-based methods, while achieving high accuracy in diagnosing potential blockages.
RL-Ballast reduces decision-making steps by nearly a third while achieving 100% accuracy in identifying blockage candidates under limited sensor conditions.
Under the Shipping 4.0 paradigm, autonomous and reduced-crew vessels require intelligent internal systems to maintain operational safety and structural stability. Ballast-water control is essential for ship trim and integrity, but conventional rule-based or manual approaches have limited adaptability to hydraulic anomalies such as valve failures and pipe blockages, and often depend on dense pressure or flow sensors for diagnosis. To address these limitations, this paper proposes RL-Ballast, a graph-based deep reinforcement learning framework for adaptive ballast-water path planning and sensor-frugal blockage candidate scoring. The valve-permutation problem is transformed into 54 feasible fluid-transfer routes generated using graph theory and depth-first search. The partially observable ballast environment is approximated with frame-stacked tank levels and action outcomes, allowing the agent to infer hidden blockage effects without explicitly modeling a high-dimensional POMDP. During deterministic inference, episode-level failed-action memory and dynamic action masking prevent repeated ineffective actions and support immediate rerouting. Failed transfer histories are further accumulated to rank suspicious valves or pipe segments without dense instrumentation. Monte Carlo simulations show that RL-Ballast completes all unexpected single-blockage scenarios and reduces average decision steps from 61.0 to 41.5 compared with a Dijkstra rule-based baseline. For diagnostic support, the failure-history scoring scheme achieves a 100% Top-3 hit rate, a 66.7% strict Top-1 hit rate, and an 83.3% Top-1 tie-hit rate under serially indistinguishable blockage conditions. These results suggest that RL-Ballast enables adaptive rerouting and maintenance-oriented blockage diagnosis under limited sensing conditions.
