Search papers, labs, and topics across Lattice.
This paper introduces PF-Trans, a Physics-embedded Frequency-aware Transformer designed to enhance spectral reconstruction in Snapshot Broadband Filter Array imaging, which suffers from severe spectral aliasing. By integrating a physical sensing model through mask injection and employing a gray-scale consistency loss, PF-Trans ensures high fidelity in reconstructed spectra. The method's innovative Dual-domain Block with a parallel Fast Fourier Transform branch allows for effective suppression of aliasing artifacts, achieving a Peak Signal-to-Noise Ratio of up to 48.50 dB, outperforming existing techniques on multiple datasets.
PF-Trans achieves a remarkable PSNR of 48.50 dB, setting a new benchmark for spectral reconstruction in remote sensing.
Snapshot Broadband Filter Array (BFA) imaging provides high light throughput for spectral reconstruction but introduces severe spectral aliasing due to complex modulation. Current deep learning approaches, limited to spatial denoising, often fail to address the global frequency-specific degradations caused by the mask structure. To address this, we propose a Physics-embedded Frequency-aware Transformer (PF-Trans) for high-fidelity remote sensing spectral reconstruction. Our method explicitly integrates the physical sensing model through mask injection and a gray-scale consistency loss to ensure physical fidelity. Furthermore, we introduce a Dual-domain Block with a parallel Fast Fourier Transform (FFT) branch, enabling the network to perceive and suppress aliasing artifacts in the frequency domain. Extensive experiments on multiple datasets demonstrate that PF-Trans achieves state-of-the-art performance, achieving a Peak Signal-to-Noise Ratio (PSNR) of up to 48.50 dB on the GF-5 Shanghai dataset, significantly outperforming comparison methods.
