Search papers, labs, and topics across Lattice.
This paper investigates the impact of data contamination in recursively trained generative AI models, where models are trained on mixtures of real and AI-generated data. The authors establish theoretical convergence guarantees for recursive training under minimal assumptions on the real data distribution and with a general universal approximator as the generative model. Their analysis demonstrates that the convergence rate is bounded by the minimum of the baseline model's convergence rate and the fraction of real data used in each iteration, even in the presence of sampling bias.
Despite the growing concern of model collapse due to AI-generated data contaminating training sets, this work shows that generative models can still converge under recursive training with provable guarantees.
Generative Artificial Intelligence (AI), such as large language models (LLMs), has become a transformative force across science, industry, and society. As these systems grow in popularity, web data becomes increasingly interwoven with this AI-generated material and it is increasingly difficult to separate them from naturally generated content. As generative models are updated regularly, later models will inevitably be trained on mixtures of human-generated data and AI-generated data from earlier versions, creating a recursive training process with data contamination. Existing theoretical work has examined only highly simplified settings, where both the real data and the generative model are discrete or Gaussian, where it has been shown that such recursive training leads to model collapse. However, real data distributions are far more complex, and modern generative models are far more flexible than Gaussian and linear mechanisms. To fill this gap, we study recursive training in a general framework with minimal assumptions on the real data distribution and allow the underlying generative model to be a general universal approximator. In this framework, we show that contaminated recursive training still converges, with a convergence rate equal to the minimum of the baseline model's convergence rate and the fraction of real data used in each iteration. To the best of our knowledge, this is the first (positive) theoretical result on recursive training without distributional assumptions on the data. We further extend the analysis to settings where sampling bias is present in data collection and support all theoretical results with empirical studies.
