Search papers, labs, and topics across Lattice.
This paper investigates mirror flows driven by a convex quadratic loss and a general convex lower semicontinuous mirror potential, revealing that trajectories initialized near the boundary converge to a limiting mirror flow characterized by the indicator function of the domain. The study establishes that in this limiting case, the primal variable effectively minimizes the loss across a dynamic hypothesis set defined by the dual variable's subdifferential of the support function. This characterization offers a novel framework for incremental learning within the context of mirror flows, enhancing understanding of how learning can adapt over time.
Trajectories in mirror flows can converge to a limiting behavior that transforms incremental learning into a dynamic optimization problem.
We study mirror flows generated by a convex quadratic loss and a general convex lower semicontinuous mirror potential. We show that, when initialized near the boundary of the domain of the mirror potential, their rescaled trajectories converge to a limiting mirror flow whose potential is the indicator function of the domain. In this limit, the primal variable minimizes the loss over a time-dependent hypothesis set: the subdifferential of the support function of the domain, evaluated at the dual variable. This characterization provides a general mechanism for incremental learning in mirror flows.
