Search papers, labs, and topics across Lattice.
This paper investigates the limitations of existing on-policy distillation (OPD) methods in diffusion models when integrating classifier-free guidance (CFG), revealing that naive matching can lead to antagonistic dynamics due to a phenomenon termed Negative Branch Asymmetry (NBA). The authors demonstrate that while naive matching can be effective under certain conditions, it fails when the teacher's negative branch retains information unavailable to the student, resulting in increased errors. To mitigate this issue, they propose Positive-Direction Matching (PDM), which enhances knowledge transfer in dense-to-sparse video control tasks by separately constraining positive predictions and CFG directions.
Naive matching in diffusion distillation can inadvertently amplify errors due to hidden information in teacher models, leading to a surprising failure mode called Negative Branch Asymmetry.
On-policy distillation (OPD) adapts diffusion models by querying a teacher along trajectories generated by the current student, but how it should behave under classifier-free guidance (CFG), a default component of modern diffusion systems, remains poorly understood. Existing OPD methods naturally extend velocity matching to the CFG-composed prediction, directly matching teacher and student guided velocities. We show that this objective is under-identified at the branch level: positive- and negative-branch errors can compensate in the guided prediction. Through two contrasting cases, we find that naive matching remains effective under shared negative conditioning, where both branch errors decrease jointly. When the model's native CFG schema retains privileged information in the teacher's negative branch that is unavailable to the student, however, this joint reduction breaks down and the composed objective induces antagonistic branch-error dynamics, reducing the positive-branch error while increasing the negative-branch error. We term this failure mode Negative Branch Asymmetry (NBA). To address NBA, we introduce Positive--Direction Matching (PDM), a branch-aware OPD objective that separately constrains the positive prediction and the CFG conditional direction. We apply PDM to dense-to-sparse video control, where naive guided matching is highly sensitive to inference guidance scales, while branch-aware supervision enables more robust and effective knowledge transfer.
