Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper extends the convergence analysis of Information-Geometric Optimization (IGO) by focusing on discrete-time updates in continuous spaces, specifically within the context of multivariate Gaussian distributions. The authors prove that under certain conditions, the covariance matrix converges to zero while the mean vector approaches the global optimum, even with a fixed positive learning rate and quantile-based weights. These findings enhance the theoretical understanding of IGO and its applicability to practical optimization methods like CMA-ES, addressing a significant gap in existing literature.
Discrete-time IGO can achieve global convergence in continuous spaces, even with fixed learning rates, challenging previous assumptions about optimization dynamics.
Information-Geometric Optimization (IGO) provides a unified framework for black-box optimization by interpreting the adaptation of a search distribution as a natural gradient update. Despite its conceptual importance, the convergence theory of IGO remains limited: most existing results concern continuous-time idealizations such as the IGO flow, rather than discrete-time updates with non-infinitesimal learning rates. In this paper, we study discrete-time IGO in continuous spaces, formulated as natural gradient updates in the expectation-parameter coordinates of an exponential family. In particular, we analyze IGO over the multivariate Gaussian family on strongly convex quadratic objective functions. Our analysis covers a setting that simultaneously incorporates full covariance adaptation, a fixed positive learning rate, and quantile-based weights. In this setting, we prove that the covariance matrix converges to the zero matrix. We further show that the mean vector converges to the global optimum, provided that the condition number of the appropriately scaled covariance matrix is bounded at sufficiently frequent iterations. These results advance the convergence theory of IGO and help bridge the gap between the mathematical theory of IGO and practical covariance-adaptive search methods such as CMA-ES.
RIKEN