Search papers, labs, and topics across Lattice.
The paper introduces FAST-DIPS, a training-free inverse problem solver leveraging diffusion priors that avoids computationally expensive adjoint calculations and inner optimization loops. It achieves this by incorporating a hard measurement-space feasibility constraint (closed-form projection) and an analytic, model-optimal step size, enabling a fixed compute budget per noise level. The method approximates the correction step via an adjoint-free, ADMM-style splitting with projection and a few steepest-descent updates, demonstrating significant speedups compared to existing methods while maintaining competitive image reconstruction quality.
Achieve up to 19.5x speedup in diffusion-prior based inverse problems by replacing slow inner loops with closed-form projections and analytic step sizes.
Training-free diffusion priors enable inverse-problem solvers without retraining, but for nonlinear forward operators data consistency often relies on repeated derivatives or inner optimization/MCMC loops with conservative step sizes, incurring many iterations and denoiser/score evaluations. We propose a training-free solver that replaces these inner loops with a hard measurement-space feasibility constraint (closed-form projection) and an analytic, model-optimal step size, enabling a small, fixed compute budget per noise level. Anchored at the denoiser prediction, the correction is approximated via an adjoint-free, ADMM-style splitting with projection and a few steepest-descent updates, using one VJP and either one JVP or a forward-difference probe, followed by backtracking and decoupled re-annealing. We prove local model optimality and descent under backtracking for the step-size rule, and derive an explicit KL bound for mode-substitution re-annealing under a local Gaussian conditional surrogate. We also develop a latent variant and a one-parameter pixel$\rightarrow$latent hybrid schedule. Experiments achieve competitive PSNR/SSIM/LPIPS with up to 19.5$\times$ speedup, without hand-coded adjoints or inner MCMC.
