Search papers, labs, and topics across Lattice.
This paper introduces the Coordination-Informed Multi-Objective Reinforcement Learning (CIMORL) framework, which enhances multi-robot systems' ability to optimize competing objectives while ensuring coordinated behavior in a decentralized manner. By integrating a distributed weight prediction mechanism and a privileged expert training strategy, the framework achieves theoretical guarantees for Pareto-optimal solutions. Experimental results show a 21.2% improvement in hypervolume and greater policy stability compared to existing methods, with successful real-world applications using Crazyflie drones in complex scenarios.
Achieving a 21.2% improvement in hypervolume, the CIMORL framework redefines how multi-robot systems can optimize competing objectives without sacrificing coordination.
Multi-robot systems must simultaneously optimize competing objectives while maintaining coordinated behavior. Existing multi-agent reinforcement learning approaches often rely on fixed or centralized coordination, which limits adaptability and violates distributed constraints. This work introduces the Coordination-Informed Multi-Objective Reinforcement Learning (CIMORL) framework, integrating a distributed weight prediction mechanism, a privileged expert training strategy, and theoretical guarantees for Pareto-optimal solutions. We present the base CIMORL method alongside two sampling-based variants, CIMORL-TS (Tree Search) and CIMORL-MPPI (MPPI), which leverage privileged global information during training to enable fully decentralized deployment. Experimental validation in cooperative and adversarial scenarios demonstrates a $21.2\%$ hypervolume improvement and superior policy stability compared to state-of-the-art baselines. Real-world experiments with Crazyflie drones further validate the framework's robustness in resource allocation and multi-attacker multi-defend scenarios under partial observability.
