Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Holistic Multivariance Decomposition (HMD) framework, a novel differentiable neural network layer designed to enhance hyperspectral image classification by effectively capturing complex spatio-spectral interdependencies without the rigidity of traditional tensor decompositions or the computational burden of convolutional networks. The HMD framework separates independent variations from cooperative interactions through learnable matrix-valued supports, optimizing these approximants alongside a downstream classifier via backpropagation. Evaluations on benchmark hyperspectral datasets reveal that HMD layers outperform classical tensor methods in classification accuracy while maintaining a parameter efficiency and training stability comparable to standard CNNs.
HMD layers achieve superior hyperspectral image classification accuracy while using significantly fewer parameters than traditional convolutional networks.
Feature extraction for hyperspectral image classification is conventionally addressed using rigid tensor decompositions that fail to capture complex spatio-spectral interdependencies, or heavily parameterized convolutional neural networks that are computationally expensive. To overcome these limitations, this work introduces the Holistic Multivariance Decomposition (HMD) framework as a novel, end-to-end differentiable neural network layer. By explicitly separating independent single mode variations from cooperative higher dimensional interactions via learnable, matrix valued supports, the proposed HMD-0, HMD-1 and HMD-2 approximants are optimized jointly with a downstream classifier via backpropagation. Comprehensive evaluations across three benchmark HS datasets demonstrate that the higher level HMD layers achieve superior classification accuracy compared to classical learnable tensor baselines, including Tucker, Canonical Polyadic, and Tensor Train decompositions. Furthermore, HMD-1 and HMD-2 achieve a generalization capacity and training stability comparable to standard 2D and 3D-CNNs while requiring significantly fewer feature extractor parameters. These results demonstrate that the HMD framework provides a structurally robust substitute for traditional convolution in multidimensional HS image classification, offering high parameter efficiency and stability throughout the optimization process.