Search papers, labs, and topics across Lattice.
This paper theoretically analyzes error propagation and model collapse in score-based diffusion models when trained recursively on synthetic data. They derive upper and lower bounds on the divergence between generated and target distributions, characterizing drift regimes based on score estimation error and the proportion of fresh data. Empirical results on synthetic data and images validate the theoretical findings.
Diffusion models degrade predictably when trained on their own outputs, but a little fresh data can keep them on track.
Machine learning models are increasingly trained or fine-tuned on synthetic data. Recursively training on such data has been observed to significantly degrade performance in a wide range of tasks, often characterized by a progressive drift away from the target distribution. In this work, we theoretically analyze this phenomenon in the setting of score-based diffusion models. For a realistic pipeline where each training round uses a combination of synthetic data and fresh samples from the target distribution, we obtain upper and lower bounds on the accumulated divergence between the generated and target distributions. This allows us to characterize different regimes of drift, depending on the score estimation error and the proportion of fresh data used in each generation. We also provide empirical results on synthetic data and images to illustrate the theory.
