Search papers, labs, and topics across Lattice.
This paper introduces MAMO, a multi-agent reinforcement learning framework designed for multi-objective constrained optimization in dynamic environments. By decoupling task execution from reward weight selection, MAMO addresses the challenge of manually tuning weights that balance primary objectives and constraint violations, which is critical in non-stationary settings. The key finding shows that this approach enhances the robustness and autonomy of RL solutions, enabling more effective decision-making in complex systems.
MAMO transforms the way we approach reward weight selection in reinforcement learning, making it a learning problem rather than a manual tuning task.
Many decision-making problems in computing and networking systems can be naturally formulated as cost-minimization problems under performance constraints. In dynamic environments, reinforcement learning (RL) is often used to solve such problems at runtime by embedding both costs and constraint violations into a single scalar reward through weighted penalty terms, following a Lagrangian-inspired formulation. However, in this context the behavior of the learned policy critically depends on the choice of these weights, which are typically selected manually. This makes it difficult to identify an appropriate trade-off between optimizing the primary objective and effectively avoiding constraint violations, particularly in non-stationary environments where their relative importance may change. This paper presents MAMO (Multi-Agent system for Multi-Objective constrained optimization), an approach to tackle this balancing problem through multi-agent RL. MAMO decouples task execution from objective design by formulating the selection of reward weights as a learning problem, providing a !rst step towards more autonomous and robust RL-based solutions for constrained optimization problems in dynamic environments.
