Track new results across pure and applied mathematics.
Search papers, labs, and topics across Lattice.
This work establishes convergence guarantees for stochastic subgradient, proximal subgradient, and general stochastic model-based methods minimizing paraconvex functions—a class generalizing weakly convex objectives to include Hölder smooth compositions. Extending optimization theory beyond standard weak convexity is critical for certifying algorithms on non-convex, non-Lipschitz objectives commonly encountered in modern machine learning. By interpreting iterations as perturbed descent trajectories over a generalized Moreau envelope, the authors show robust convergence across an expansive family of stochastic algorithms satisfying mild approximation-quality bounds.
Stochastic optimization guarantees no longer stop at weak convexity: model-based algorithms can now reliably converge across broader paraconvex landscapes, including non-Lipschitz and Hölder-smooth compositions.
This paper studies stochastic algorithms for minimizing paraconvex functions, a function class that generalizes weakly convex functions and includes, for instance, Hölder smooth functions and compositions of convex functions with Hölder smooth maps. We first establish the convergence of the stochastic subgradient method and the stochastic proximal subgradient method for unconstrained and composite paraconvex optimization, respectively. The analysis is then extended to a broad family of algorithms that access the objective through stochastic models satisfying certain approximation-quality and continuity assumptions. The main principle that underlies the convergence analysis is that the algorithms under consideration can be interpreted as perturbed descent methods on the generalized Moreau envelope of the original paraconvex problem.