Search papers, labs, and topics across Lattice.
This paper critiques the common practice of merely scaling up multimodal environment pools for agent training, revealing that increased quantity does not guarantee improved performance. The authors introduce two innovative strategies: Ability-aware Environment Selection (AES) to enhance diversity in training environments, and Hierarchical Difficulty Curriculum (HDC) to structure learning through progressive difficulty levels. Experimental results demonstrate that these methods significantly enhance the training efficacy of multimodal agents, addressing key limitations in existing approaches.
Simply adding more multimodal environments can hinder agent performance, but targeted diversity and structured difficulty can transform training outcomes.
Recent works train agents by constructing large-scale multimodal environment pools. However, we find that simply increasing the number of multimodal environments does not always benefit. We further analyze the limitations in current multimodal environment distributions through a series of experiments. Based on these findings, we study how to build more effective training environment distributions from two dimensions: **diversity** and **difficulty structure**. For diversity, we propose **Ability-aware Environment Selection (AES)** to obtain diverse environment sets. For difficulty structure, we propose **Hierarchical Difficulty Curriculum (HDC)**, which organizes curriculum learning through two difficulty levels: harness weakening and state-scale progression. Experiments show that AES and HDC effectively improve multimodal agent training.
