Search papers, labs, and topics across Lattice.
This paper introduces a generalized symmetric matrix factorization model applicable to various fields, unifying different matrix factorization formulations. They prove an exact penalty property, demonstrating that a symmetry-inducing quadratic penalty can enforce symmetry under specific conditions, and establish an exact relaxation relationship linking stationary points of the original objective function to a relaxed potential function. Based on these properties, they propose an average-type nonmonotone alternating updating method (A-NAUM) with a nonmonotone line search, proving its global convergence and efficiency through numerical experiments on real datasets.
Achieve fast and effective generalized symmetric matrix factorization by exploiting exact penalty and relaxation properties, enabling efficient solutions for a broad class of problems.
In this paper, we study a nonconvex, nonsmooth, and non-Lipschitz generalized symmetric matrix factorization model that unifies a broad class of matrix factorization formulations arising in machine learning, image science, engineering, and related areas. We first establish two exactness properties. On the modeling side, we prove an exact penalty property showing that, under suitable conditions, the symmetry-inducing quadratic penalty enforces symmetry whenever the penalty parameter is sufficiently large but finite, thereby exactly recovering the associated symmetric formulation. On the algorithmic side, we introduce an auxiliary-variable splitting formulation and establish an exact relaxation relationship that rigorously links stationary points of the original objective function to those of a relaxed potential function. Building on these exactness properties, we propose an average-type nonmonotone alternating updating method (A-NAUM) based on the relaxed potential function. At each iteration, A-NAUM alternately updates the two factor blocks by (approximately) minimizing the potential function, while the auxiliary block is updated in closed form. To ensure the convergence and enhance practical performance, we further incorporate an average-type nonmonotone line search and show that it is well-defined under mild conditions. Moreover, based on the Kurdyka-{\L}ojasiewicz property and its associated exponent, we establish global convergence of the entire sequence to a stationary point and derive convergence rate results. Finally, numerical experiments on real datasets demonstrate the efficiency of A-NAUM.
