Search papers, labs, and topics across Lattice.
This paper introduces Pixel Adaptive Kolmogorov-Arnold Networks (PAKAN), a novel approach to pansharpening that uses dynamically generated spline summation weights within KANs to better fuse panchromatic and multispectral images. PAKAN includes 2D Adaptive KAN for spatial feature fusion and 1D Adaptive KAN for spectral feature refinement, allowing for pixel-specific adaptation during inference. Experiments show that PAKAN modules significantly improve pansharpening performance compared to existing methods by enabling more flexible and adaptive non-linear mappings.
By dynamically adapting activation functions at the pixel level, PAKAN achieves state-of-the-art performance in pansharpening, demonstrating the power of adaptive neural operators for image fusion.
Pansharpening aims to fuse high-resolution spatial details from panchromatic images with the rich spectral information of multispectral images. Existing deep neural networks for this task typically rely on static activation functions, which limit their ability to dynamically model the complex, non-linear mappings required for optimal spatial-spectral fusion. While the recently introduced Kolmogorov-Arnold Network (KAN) utilizes learnable activation functions, traditional KANs lack dynamic adaptability during inference. To address this limitation, we propose a Pixel Adaptive Kolmogorov-Arnold Network framework. Starting from KAN, we design two adaptive variants: a 2D Adaptive KAN that generates spline summation weights across spatial dimensions and a 1D Adaptive KAN that generates them across spectral channels. These two components are then assembled into PAKAN 2to1 for feature fusion and PAKAN 1to1 for feature refinement. Extensive experiments demonstrate that our proposed modules significantly enhance network performance, proving the effectiveness and superiority of pixel-adaptive activation in pansharpening tasks.
