Search papers, labs, and topics across Lattice.
This paper introduces self-generated error training for token editing in diffusion language models, addressing the training-inference mismatch observed in existing token-to-token (T2T) editing methods. By employing a two-pass approach where the model first generates a draft and then supervises recovery from its own predicted errors, the authors demonstrate significant improvements in accuracy while reducing the intensity of T2T edits. The results show that this method effectively mitigates common failure modes, such as transcription errors and excessive self-correction, enhancing the overall performance of the model during inference.
Self-generated error training reduces T2T edit intensity and boosts accuracy, tackling critical failure modes in language model outputs.
Token-to-token (T2T) editing lets LLaDA2.1 revise committed tokens during block-diffusion decoding. The released recipe trains this editor on random vocabulary corruptions, but at inference the editor sees the model's own fluent, high-confidence draft errors instead. We study this training-inference mismatch and propose self-generated T2T, which performs a no-gradient draft pass, fills masked positions with predicted tokens, and supervises recovery in a second pass under these self-generated corruptions. We implement the update as a short LoRA continued-pretraining pass on LLaDA2.1-mini and evaluate on several benchmarks under the official Q-Mode T2T procedure with unchanged inference parameters. The method generally improves accuracy while reducing T2T edit intensity, mitigating failure modes such as final-digit transcription errors after otherwise correct reasoning and excessive self-correction before short factual answers.
