Search papers, labs, and topics across Lattice.
This paper investigates the optimization dynamics of diffusion autoencoders, revealing that they can achieve comparable image quality while learning different latent structures. By analyzing the trajectories of image reconstruction versus latent representation quality, the authors identify two distinct training regimes: one prioritizing image fidelity and the other focusing on gradual improvement in both reconstruction and disentanglement. The introduction of SteeringDRL, which combines gated residual U-Nets with a controlled noise-level exposure curriculum, effectively steers optimization towards stronger representations, enhancing performance across various disentanglement benchmarks and improving segmentation quality in object-centric learning tasks.
SteeringDRL reshapes the optimization landscape of diffusion autoencoders, leading to significantly improved representation quality and reduced seed sensitivity.
We study why diffusion autoencoders can achieve similar image quality while learning substantially different latent structures. We trace this behaviour to optimisation dynamics; we analyse curves of image reconstruction against latent representation quality, revealing trajectories that organise around two distinct regimes early in training. Models in the reconstruction regime prioritise image fidelity early, whereas those in the disentanglement regime improve reconstruction and disentanglement more gradually. We hypothesise that this behaviour can be influenced by targeting shortcut pathways in the diffusion U-Net and controlling early noise-level exposure, thereby shaping the reconstruction-disentanglement trade-off during training. To steer optimisation toward stronger representations, we introduce SteeringDRL, combining gated residual U-Nets with a simple noise-level exposure curriculum for training. Across disentanglement benchmarks, SteeringDRL improves representation quality and reduces seed sensitivity. Our method further extends to spatial disentanglement in object-centric learning, improving segmentation quality on synthetic and real-world datasets.
