Search papers, labs, and topics across Lattice.
This study investigates zero-shot task generalization in offline multi-agent reinforcement learning (MARL) by analyzing the effects of task diversity, dataset size, and network capacity. The authors extend offline sequence modeling architectures to accommodate multi-task observation and action spaces, revealing that increasing task diversity is more critical than simply enlarging the dataset for achieving robust zero-shot transfer. Their experiments across four complex environments show that a multi-task approach yields a 3.2x improvement on held-out test tasks compared to single-task models and surpasses strong behavior cloning baselines, highlighting the importance of training distribution diversity in MARL development.
Scaling task diversity, not just dataset size, is the key to achieving robust zero-shot generalization in offline multi-agent reinforcement learning.
Generalising to unseen tasks remains a fundamental challenge in offline multi-agent reinforcement learning (MARL). In this work, we present a principled analysis of zero-shot task generalisation in the offline setting and conduct an extensive empirical investigation into the scaling behaviour governing task diversity, dataset size, and network capacity. To facilitate this study, we extend offline sequence modelling architectures to handle multi-task observation and action spaces alongside variable agent counts across tasks. Our primary finding is that scaling task diversity---rather than sheer dataset size is the dominant factor in achieving robust zero-shot transfer. Through large-scale experiments across four challenging environments (Connector, RWARE, SMAX, and LBF), we demonstrate that our multi-task approach achieves a mean improvement of 3.2x on held-out test tasks compared to single-task models and consistently outperforms strong behaviour cloning baselines. These results suggest that the development of generalisable MARL agents should prioritise the diversity of the training distribution with varying numbers of agents, providing a roadmap for scaling offline MARL effectively.
