Search papers, labs, and topics across Lattice.
This paper introduces diffeomorphic optimization, a method that leverages diffusion and flow models to navigate the complex loss landscapes of generative models while maintaining optimization on low-dimensional manifolds. By applying differential geometry, the authors demonstrate that this approach is akin to Riemannian gradient descent, ensuring that optimization trajectories remain on the manifold and resulting in a smoother loss surface. In practical applications, the method significantly outperforms existing techniques in protein design, achieving higher accuracy in secondary structure targeting and faster peptide binding affinity predictions.
Diffeomorphic optimization achieves a remarkable 91.3% accuracy in secondary structure targeting, far surpassing traditional methods.
Generative models learn data distributions that reside on a low-dimensional manifold within a higher-dimensional ambient space. Optimizing differentiable objectives on this manifold is challenging: the ambient loss landscape is high-dimensional, rugged, and non-convex. Direct gradient descent, blind to the manifold's geometry, quickly drifts off it. Diffeomorphic optimization starts from the observation that diffusion and flow models provide a map from the data manifold to a much simpler base space in which we perform gradient descent. Using differential geometry, we show this is equivalent to Riemannian gradient descent on the data manifold up to $\mathcal{O}(位^2)$ corrections, keeping trajectories on-manifold by construction and yielding a smoother optimization surface. For protein design, we extend diffeomorphic optimization to the matrix Lie groups $\mathrm{SO}(3)$ and $\mathrm{SE}(3)$, deriving an autograd-compatible $\mathrm{SO}(3)$ gradient and a generalized adjoint-state method for backpropagation through Lie-group ODE solvers. Diffeomorphic optimization improves over tuned guidance on secondary-structure targeting with FrameFlow ($91.3\%$ vs. $63.3\%$ of residues in the Ramachandran target), outperforms OC-Flow on peptide binding affinity at $2\times$ the speed, and reduces Rosetta energies by thousands of units across the PDB test set for structures with hundreds of residues.
