Search papers, labs, and topics across Lattice.
This paper addresses the limitations of existing dataset condensation methods for diffusion model training, which often fail to maintain the necessary distributional geometry. By reformulating real subset selection as a geometry-aware distribution alignment problem using one-sided partial optimal transport, the authors ensure that the selected subset retains the essential geometric structure for effective training. Their approach, complemented by feature-statistics and semantic consistency regularization, demonstrates significant improvements in fidelity and distributional coverage across various experimental conditions.
Geometry-aware dataset condensation can dramatically enhance the fidelity of diffusion models, preserving essential distributional characteristics that traditional methods overlook.
Dataset condensation aims to construct compact datasets from real data via synthesis or selection. However, existing approaches are ill-suited for diffusion model training: synthetic data generation often yields low-fidelity samples unsuitable for authentic modeling, while real subset selection typically fails to preserve the distributional geometry required by diffusion likelihood objectives. To address this, we propose to reformulate real subset selection as a geometry-aware distribution alignment problem. By incorporating one-sided partial optimal transport, our method selectively aligns a compact subset with the full data distribution while allowing unmatched mass in low-density regions, ensuring the preserved geometric structure necessary for effective diffusion model training. To further ensure distributional fidelity, we complement geometric alignment with lightweight feature-statistics and semantic consistency regularization. An efficient two-stage discrete optimization strategy is proposed to achieve this alignment objective. Extensive experiments across diffusion variants, subset sizes, image resolutions, and training rounds show that our method achieves superior fidelity and distributional coverage in diffusion model training. Codes are available at https://github.com/2018cx/GADC.
