Search papers, labs, and topics across Lattice.
This paper introduces a novel utility function, Altruistic and Fairness Preference (AFP), designed to enhance cooperation among agents in multi-agent reinforcement learning (MARL) within social dilemma contexts. By integrating altruistic and fairness preferences, the AFP mechanism incentivizes agents to prioritize collective rewards and equitable outcomes, leading to improved mutual cooperation compared to standard reinforcement learning and inequity aversion agents. Experimental results demonstrate that AFP agents not only achieve higher collective rewards but also exhibit greater equity in their interactions, highlighting the effectiveness of social preferences in fostering cooperation.
AFP agents outperformed traditional methods, achieving mutual cooperation and higher equity in social dilemmas by leveraging social preferences.
Inducing cooperation among distributed agents is still a difficult problem in the field of multi-agent reinforcement learning (MARL), particularly in social dilemma situations. There, individual interests are misaligned with the common good and individual rationality leads to suboptimal group outcomes. In contrast, humans are able to achieve cooperation with one another in such situations. A common explanation for such cooperative behavior is that individuals have social preferences. In order to achieve cooperation in MARL, we design a new utility function integrating altruistic preferences (incentive for other's reward) and fairness preferences (incentive for equality) from social psychology and behavioral economics, namely, Altruistic and Fairness Preference (AFP), a reward-sharing mechanism which converts one's own and other's rewards to incentives for cooperative behavior. We performed comparative experiments with standard RL and inequity aversion agents in two challenging sequential social dilemma games, and showed that AFP agents successfully achieved mutual cooperation with more collective rewards and higher equity than the baselines. To further understand the progression of AFP during training, we subsequently explore the effects of altruistic preferences and fairness preferences on agents' behavior. The results suggest that altruistic preferences encourage agents to contribute to the public goods, and fairness preferences induce mutual behavior between agents.
