Search papers, labs, and topics across Lattice.
This paper explores the deployment of millimeter-wave base stations in a complex campus environment using multi-agent off-policy deep reinforcement learning (DRL) techniques. By framing the base station placement as a Markov Decision Process (MDP) and comparing various DRL methods, the authors reveal that the multi-agent DDPG framework significantly outperforms single-agent approaches, achieving full coverage and a Jain's fairness index of 0.94. The findings highlight the effectiveness of multi-agent systems in optimizing non-convex, NP-hard problems in real-world scenarios.
Multi-agent DDPG achieves full coverage and a remarkable fairness index of 0.94, outperforming single-agent methods in complex campus environments.
Deep reinforcement learning (DRL) has recently gained a great attention due to its real-time adaptation and effectiveness in complex optimization problems. This paper investigates the optimal deployment of millimeter-wave (mmWave) base stations (BSs) in a realistic, non-convex campus topology. The optimization problem is NP-hard, due to the non-convex, non-smooth nature of the max-min fairness objective. To overcome these constraints, we formulate the BS placement as a Markov Decision Process (MDP) and systematically benchmark four DRL schemes: a discrete single-agent Deep Q-Network (DQN), a spatially partitioned Multi-Agent DQN, a continuous single-agent Deep Deterministic Policy Gradient (DDPG), and a geographically partitioned multi-agent DDPG framework. Numerical evaluations reveal that the multi-agent DDPG approach substantially outperforms single-agent in dense scenarios. Additionally full coverage is achieved, and a fairness Jain's index of 0.94 is obtained. Finally, the multi-agent demonstrates highly efficient computational convergence of dense scenarios with $400$ users.
