Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
The authors investigate whether the expensive constraint projection in nonconvex stochastic optimization can be deferred entirely to the final iteration. Standard Projected SGD incurs prohibitive per-step projection costs in applications like safe LLM alignment and constrained fine-tuning, severely bottlenecking training when handling complex functional constraints. They show that penalized proximal methods achieve optimal $\widetilde O(\epsilon^{-4})$ stochastic oracle complexity with exact feasibility guarantees across weakly convex objectives and smooth nonconvex constraints using only one terminal projection onto the constraint set.
Constrained stochastic optimization no longer requires expensive per-step projections: a single projection at the very end of training is sufficient to guarantee exact feasibility and optimal $\widetilde O(\epsilon^{-4})$ convergence.
Constrained nonconvex optimization has seen increasing application in modern machine learning, such as safe LLM alignment/finetuning, transfer learning and rank-constrained continual learning. The commonly used approach is Projected SGD which requires projection at every iteration. However, projection onto a functional constraint can cost substantially more than a stochastic first-order update. We study whether this operation can be deferred until the end of nonconvex stochastic optimization, and only do it once. For weakly convex, possibly nonsmooth objectives with regular convex constraints, we give a penalized proximal method that uses $\widetilde O(ε^{-4})$ stochastic subgradients and one projection onto the constraint set. The returned point is exactly feasible and has a small Moreau-envelope stationarity measure; for smooth objectives, the same algorithm controls the projected-gradient mapping. For smooth nonconvex constraints, we assume a global lower bound on the infeasible constraint slope which permits arbitrary, possibly infeasible initialization. An exact-penalty variant attains the same stochastic-oracle order and returns an exactly feasible point within $O(ε)$ of an $ε$-KKT point. All intermediate updates use only projections onto a simple Euclidean ball. These are oracle-complexity guarantees: the cost of the single terminal projection is separate, and no efficient projection algorithm for a general nonconvex set is assumed to follow from regularity.