Search papers, labs, and topics across Lattice.
This paper addresses the problem of cost-efficient packet delivery for latency-sensitive applications in next-generation networks, where packets must be delivered within strict deadlines. They formulate the problem as a constrained Markov decision process and apply constrained deep reinforcement learning (CDRL) to minimize resource allocation costs while maintaining a target reliability level for timely throughput. Experiments demonstrate that the proposed CDRL approach ensures timely packet delivery and achieves lower costs compared to throughput-maximizing methods, outperforming existing baselines.
Constrained deep RL can ensure timely packet delivery in next-gen networks while slashing resource allocation costs, even when traditional methods fail.
Next-generation networks aim to provide performance guarantees to real-time interactive services that require timely and cost-efficient packet delivery. In this context, the goal is to reliably deliver packets with strict deadlines imposed by the application while minimizing overall resource allocation cost. A large body of work has leveraged stochastic optimization techniques to design efficient dynamic routing and scheduling solutions under average delay constraints; however, these methods fall short when faced with strict per-packet delay requirements. We formulate the minimum-cost delay-constrained network control problem as a constrained Markov decision process and utilize constrained deep reinforcement learning (CDRL) techniques to effectively minimize total resource allocation cost while maintaining timely throughput above a target reliability level. Results indicate that the proposed CDRL-based solution can ensure timely packet delivery even when existing baselines fall short, and it achieves lower cost compared to other throughput-maximizing methods.
