Search papers, labs, and topics across Lattice.
This paper investigates the optimization dynamics of curriculum learning in large language models by analyzing how different difficulty levels influence knowledge transfer during training. The authors introduce a novel metric, Relative Transfer, to characterize the effectiveness of various curriculum schedules, leading to the development of Transfer-aware Dynamic Curriculum Sampling (TDCS). Extensive experiments reveal that TDCS significantly outperforms traditional scheduling methods across diverse reasoning tasks, providing a unified framework for understanding curriculum learning's efficacy.
Understanding the dynamics of knowledge transfer reveals that a tailored curriculum can dramatically enhance performance across reasoning tasks in large language models.
Curriculum learning has been widely adopted in the post-training of large language models by organizing training data from easy to hard. However, its effectiveness varies substantially across reasoning tasks, suggesting that no single curriculum is universally optimal and raising a fundamental question: what determines when curriculum learning works? In this paper, we answer this question by analyzing the optimization dynamics induced by different curriculum schedules. We show that the transfer relationship between different difficulty levels characterizes the optimization dynamics induced by curriculum learning, which in turn explains the effectiveness of different curriculum schedules, and formalize this relationship as Relative Transfer, a principled measure of cross-difficulty knowledge transfer. Based on this measurement, we derive Transfer-aware Dynamic Curriculum Sampling (TDCS), which dynamically adjusts the sampling distribution according to the estimated transfer relationship throughout training. Extensive experiments on multiple reasoning benchmarks demonstrate that TDCS consistently outperforms representative scheduling strategies across different tasks, model scales, and training paradigms. More importantly, our work provides a unified optimization-based explanation of curriculum learning through cross-difficulty transfer.
