Search papers, labs, and topics across Lattice.
Addressing the rapid quality collapse of instruction-based image editing under recursive inference, the authors present MT-OPSD, an on-policy self-distillation framework paired with a 10-turn benchmark (LME-Bench). The compounding failure stems from an exposure bias where models trained strictly on clean inputs must sequentially condition on their own imperfect generation artifacts. By supervising a student conditioned on self-generated rollouts with a clean-conditioned teacher model, MT-OPSD mitigates multi-turn degradation across three backbones without requiring multi-turn training annotations.
Recursive image editing collapses not from weak visual priors, but from exposure bias to model artifacts—a failure mode fixable entirely without multi-turn data by distilling clean teachers into on-policy rollouts.
Instruction-based image editing has achieved strong performance in single-turn settings, yet practical editing is often iterative, with each instruction applied to the output of the previous turn. We find that existing editing models degrade rapidly under recursive editing and attribute this failure to a train-test mismatch in the conditioning distribution: models are trained on clean source images but must repeatedly condition on their own imperfect outputs at inference time. To address this, we propose MT-OPSD, an on-policy self-distillation framework that trains the model on self-generated conditioning states with editing supervision from a clean-conditioned teacher, without requiring multi-turn annotations. We further introduce LME-Bench, a benchmark of 100 ten-turn editing sessions for evaluating long-horizon robustness. Experiments across three editing backbones show that MT-OPSD substantially improves long-horizon editing success and reduces multi-turn collapse while largely preserving single-turn editing quality.