Search papers, labs, and topics across Lattice.
This paper introduces an information-theoretic framework for optimizing classifier-free guidance (CFG) schedules in diffusion models, addressing the trade-off between condition consistency and diversity. By leveraging a clean endpoint reference, the authors optimize the distribution induced by the guided sampler to achieve the desired consistency-coverage balance. Experiments on ImageNet-512 and COCO demonstrate that the proposed adaptive schedules outperform constant guidance, achieving better trade-offs and selectively allocating guidance across noise levels.
Adaptive CFG schedules can enhance diversity without sacrificing consistency, outperforming traditional constant guidance methods.
Diffusion models have achieved strong performance in image, text-to-image, and video generation, where conditional generation is often controlled by classifier-free guidance (CFG). CFG improves condition consistency by increasing a guidance weight, but stronger guidance typically reduces diversity and distributional coverage. It remains unclear how this consistency-coverage trade-off should be controlled across the reverse trajectory, since the distribution induced by CFG is not simply the fixed-time tilted distribution given by the guided score field. To address this issue, we propose an information-theoretic framework for CFG schedule optimization. Our approach uses a clean endpoint reference to specify the desired consistency-coverage trade-off, while optimizing the actual distribution induced by the guided sampler toward this reference. We derive trajectory-level formulas to estimate the objective from samples and score evaluations, avoiding explicit density estimation. On ImageNet-512 with EDM-XXL and COCO with SD-XL, the learned schedules achieve competitive or improved trade-offs over constant guidance and allocate guidance selectively across noise levels.
