Search papers, labs, and topics across Lattice.
This paper investigates the spectral stability of Extreme Learning Machines (ELMs) by analyzing the influence of the hidden layer matrix's singular value structure on output weight perturbations. It establishes that the smallest singular value is critical in determining the amplification of perturbations, while the condition number quantifies the instability of the hidden layer. Through comparisons of SVD-based pseudoinverse computation and iterative hyperpower methods, the authors find that SVD methods outperform iterative approaches in terms of reliability under ill conditioning, highlighting the importance of spectral properties in ELM stability.
The stability of Extreme Learning Machines hinges on the hidden layer's singular value structure, revealing that SVD methods are crucial for reliable performance under challenging conditions.
Extreme Learning Machine (ELM) computes output weights analytically using the Moore-Penrose pseudoinverse. Although this leads to fast training, its numerical stability depends strongly on the conditioning of the hidden layer matrix. This paper studies pseudoinverse-based ELM from a spectral perspective. We show that the smallest singular value governs perturbation amplification in the output weights, while the condition number provides a quantitative measure of hidden-layer instability. We compare SVD-based pseudoinverse computation with iterative hyperpower methods and discuss width-dependent conditioning through a random feature interpretation. Experiments on synthetic matrices and ELM benchmarks show that SVD-based methods remain the most reliable under ill conditioning, while iterative methods are more sensitive to spectral properties. The results suggest that ELM stability is fundamentally governed by the singular value structure of the hidden layer matrix.
