Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors introduce Geometrically Modified Outputs (GMOs), a framework that strengthens the negative signal in self-training generative models by reweighting the singular values of the generator's input-output Jacobian along its leading directions. While negative-guidance approaches repurpose model collapse to steer generation away from degeneracies, existing methods passively accept standard synthetic samples as negative targets. By deliberately amplifying mode-seeking distortions and artifacts, GMOs consistently boost generation quality when integrated into negative-guidance pipelines like Neon and SIMS across one-step generative models.
Model collapse in generative self-training can be weaponized: intentionally amplifying a generator's Jacobian-derived geometric distortions creates a far more potent negative guidance signal than standard synthetic outputs.
Self-training generative models - the continued improvement of a model using its own outputs - is becoming increasingly important as high-quality training data becomes scarce. However, naively finetuning on model-generated samples leads to degradation through model collapse and the model autophagy disorder. Negative-guidance self-training methods turn this degradation into a useful signal, using a model finetuned on its own outputs to guide the original model toward improved generation. Existing methods, however, take the negative signal in standard model outputs as given. We instead ask whether this signal can be explicitly strengthened. We introduce Geometrically Modified Outputs (GMOs), which reweight the singular values of the generator's input-output Jacobian to increase the influence of its leading singular directions. This geometric modification amplifies the mode-seeking behavior and distortions of standard outputs, providing a stronger and more targeted negative signal for self-training. Across a range of one-step generative models, GMOs consistently improve the performance of negative-guidance methods, including Neon and SIMS, compared with using standard model outputs.