Search papers, labs, and topics across Lattice.
This study tackles the dynamic battery management problem for Autonomous Mobile Robots (AMRs) in warehouses by employing a Proximal Policy Optimization (PPO)-based Deep Reinforcement Learning (DRL) framework. The proposed model effectively learns optimal charging station selection and duration while considering queuing times, outperforming traditional heuristics and other DRL methods. Results indicate a notable increase in order-completion rates by up to 6% and a significant reduction in recharging time across various warehouse configurations.
A PPO-based DRL framework boosts order-completion rates by 6% while slashing recharging time for Autonomous Mobile Robots in dynamic warehouse environments.
Battery charging of Autonomous Mobile Robots (AMRs) in warehouses is a critical operational challenge that heavily impacts both order processing times and throughput. In this study, we address the dynamic AMR charging problem under stochastic order arrivals, where robots must learn optimal charging decisions. Traditional fixed-rule heuristics often prove suboptimal in dynamic environments and fail to account for multi-AMR coordination, leading to severe resource inefficiencies. To overcome these limitations, we propose a Proximal Policy Optimization (PPO)-based Deep Reinforcement Learning (DRL) framework designed for multi-block warehouses with fixed charging stations. Our model dynamically learns two key decisions: charging station selection and optimal charging duration, explicitly accounting for anticipated queuing times at the stations. Extensive numerical experiments benchmark the proposed model against state-of-the-art DRL and traditional heuristic approaches. Results demonstrate that our PPO framework increases order-completion rates by up to 6\% compared to the strongest baseline, while significantly reducing the total time dedicated to recharging operations. Furthermore, we validate the model's robustness across diverse warehouse configurations and stochastic arrival rates. Finally, we interpret the learned DRL policy, offering valuable operational insights into its superiority over standard benchmarks.
