Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel framework that integrates $\alpha$-fairness into Heterogeneous-Agent Trust Region Learning (HATRL) to address the inequities often present in multi-agent systems. By employing a fair advantage function that dynamically adjusts agent utilities, the framework ensures monotonic improvement and convergence to Nash Equilibria while transitioning from utilitarian objectives to $\alpha$-fair welfare. Experimental results in sequential social dilemmas demonstrate that the proposed algorithms, $\alpha$-fair HATRPO and $\alpha$-fair HAPPO, outperform traditional HATRL methods in both efficiency and social equity.
Bridging fairness and efficiency, this framework shows that $\alpha$-fairness can enhance cooperation in multi-agent systems without sacrificing performance.
Cooperation in multi-agent systems is typically optimized through utilitarian objectives that maximize overall efficiency but fail to account for reward distribution, often resulting in inequitable"leader-follower"dynamics. While fairness-based approaches encourage pro-social behaviors where every agent benefits from cooperation, many current algorithms - including those utilizing reward shaping - break the stationarity of Markov Games or lack rigorous theoretical guarantees. This creates a critical gap between fair objective methods and theoretically safe learning frameworks. We propose a novel framework that bridges $\alpha$-fairness with Heterogeneous-Agent Trust Region Learning (HATRL), ensuring monotonic improvement and convergence toward Nash Equilibria. Our approach leverages a fair advantage function that dynamically weights agent utilities based on their expected returns, allowing the global objective to transition from purely utilitarian efficiency to $\alpha$-fairness welfare based on the parameter $\alpha$. We introduce two practical algorithms, $\alpha$-fair HATRPO and $\alpha$-fair HAPPO, and demonstrate through experiments in sequential social dilemmas like CleanUp and CommonHarvest that they perform better than HATRL's algorithms from a utilitarian point of view while achieving socially higher outcomes.