Search papers, labs, and topics across Lattice.
This paper introduces SHFormer, a novel architecture that combines a spectral filtering convolutional neural network with a high-pass kernel generation transformer to enhance MRI reconstruction quality. By leveraging a neuromodulation-based discriminative multi-spectral attention mechanism, SHFormer effectively captures high-frequency details and transferable features across diverse MRI modalities, overcoming the limitations of traditional attention mechanisms that struggle with high-frequency representation. The model demonstrates significant improvements in reconstruction quality, achieving an approximate 1 dB increase in PSNR and 0.01 in SSIM in challenging unseen scenarios.
SHFormer achieves a remarkable 1 dB improvement in MRI reconstruction quality by effectively capturing high-frequency details across diverse modalities.
Attention Mechanism (AM) selectively focuses on essential information for imaging tasks and captures relationships between distant pixel neighborhoods to compute feature representations. Accelerated MRI reconstruction benefits from AM, as the imaging process involves Fourier domain measurements that influence image representation non-locally. However, AM-based models are more adept at capturing low-frequency information with limited capacity for high-frequency representations, restricting models to smooth reconstruction. Additionally, AM-based models need mode-specific retraining for multimodal MRI data, as their knowledge is restricted to local contextual variations that may be inadequate to capture transferable features across heterogeneous domains. To address these challenges, we propose a neuromodulation-based discriminative multi-spectral AM for scalable MRI reconstruction that can (i) propagate context-aware high-frequency details for high-quality reconstruction, and (ii) capture features reusable across deviated unseen domains in multimodal MRI. The proposed network consists of a spectral filtering CNN to capture mode-specific transferable features and a dynamic high-pass kernel generation transformer focusing on high-frequency details. We evaluate our model on comparative studies in supervised and self-supervised learning, diffusion model-based training, closed-set and open-set generalization under heterogeneous MRI data, and interpretation-based analysis. Our method offers scalable, high-quality reconstruction with best improvement margins of ~1 dB in PSNR and ~0.01 in SSIM under unseen scenarios. Code: https://github.com/sriprabhar/SHFormer
