Search papers, labs, and topics across Lattice.
This paper introduces SoftCap, a training-free control layer for accelerating Diffusion Transformer (DiT) inference by dynamically adjusting the threshold for triggering full Transformer evaluations based on a soft budget. SoftCap uses a Trajectory Drift Observer to estimate cache risk from hidden-state statistics, coupled with a Soft-Budget PI Controller that adapts the full-triggering threshold based on realized compute relative to a reference profile. Experiments on FLUX.1-dev demonstrate that SoftCap outperforms SpeCa, improving image quality metrics (ImageReward and LPIPS) at comparable FLOPs, while exhibiting the desired soft-ceiling behavior.
Achieve better image quality in Diffusion Transformers without extra training by dynamically trading off compute and cache risk.
Diffusion Transformers (DiTs) achieve strong visual quality, but their iterative denoising process requires many costly Transformer evaluations. Training-free acceleration methods reduce this cost by caching, forecasting, or verifying intermediate features, yet the runtime decision of when to execute a Full step is often driven by fixed schedules or hand-tuned thresholds. We propose \textbf{SoftCap}, a training-free control layer for cache-based DiT inference. SoftCap couples a Trajectory Drift Observer, which estimates local cache risk from lightweight hidden-state statistics, with a Soft-Budget PI Controller, which adjusts the Full-triggering threshold from realized compute relative to a fixed reference profile. The budget is a soft ceiling: it shapes the threshold but does not require a run to spend a prescribed number of Full evaluations. On FLUX.1-dev, SoftCap improves over SpeCa at a comparable middle-compute operating point, raising ImageReward from 0.967 to 0.981 and reducing LPIPS-Full from 0.518 to 0.498 at nearly identical FLOPs, while target-sweep diagnostics show the intended soft-ceiling behavior as the budget is relaxed.
