Search papers, labs, and topics across Lattice.
This paper establishes the mathematical foundations of linear independent component analysis (ICA) by exploring the characteristic functions of probability measures and their role in identifying distributions. It provides a comprehensive analysis of identifiability results for ICA models under varying assumptions about the sources, demonstrating that independent sources can be identified even amidst additive Gaussian noise. The authors also introduce an online equivariant gradient descent algorithm for effectively recovering independent sources from data in a noiseless non-Gaussian context.
Independent sources can be identified even in the presence of Gaussian noise, challenging previous assumptions about the robustness of ICA models.
We present the mathematical foundations of linear independent component analysis (ICA) models based on standard literature in a self-contained note. It is aimed at readers with a background in measure-theoretic probability theory. We first develop the theory of the characteristic functions of probability measures on $\mathbb{R}^d$, including their analyticity and the way in which they determine and characterise the distributions. We then focus on several identifiability results of ICA models with successively strengthened assumptions on the sources: from merely non-constant, to non-Gaussian, to Gaussian-free independent sources. Under the strictest assumptions, we show that the independent sources are identifiable up to translation, permutation, scales and signs, and this even in the presence of additive Gaussian noise. Furthermore, we present the online equivariant gradient descent ICA algorithm for recovering the independent sources from data, in the standard complete noiseless non-Gaussian ICA setting.
