Search papers, labs, and topics across Lattice.
The Dynamic SpectraFormer addresses the challenges of color distortion, haze, and poor visibility in underwater images by employing a frequency domain transformer that enhances image quality through a novel sparse spectrum attention module. This approach effectively captures long-term dependencies while dynamically selecting critical frequency bands to rectify both high- and low-frequency distortions. Extensive evaluations demonstrate that the Dynamic SpectraFormer significantly outperforms traditional methods in enhancing underwater image clarity and detail.
Underwater images can be dramatically improved by a transformer that intelligently selects and enhances critical frequency bands, overcoming traditional limitations in image quality.
Underwater images suffer from color distortion, haze, and poor visibility due to light refraction and absorption in water. These challenges significantly impact the utilization of Autonomous Underwater Vehicles (AUVs) or marine robots. Typically, color and brightness distortions manifest at lower frequencies, while edge and texture distortions are prevalent at higher frequencies. Traditional methods struggle to concurrently rectify these mixed distortions as they primarily concentrate on the spatial domain. To address these issues, we introduce the Dynamic SpectraFormer, which enhances under-water images through a frequency domain transformer. The Dynamic SpectraFormer introduces an ultra-high-resolution sparse spectrum attention module, which could capture the long-term dependency without losing the universal approximating power. Additionally, we have developed a dynamic spectrum weight generation layer that serves as an adaptive spectrum band selector, accentuating critical frequency bands and suppressing less relevant ones. Consequently, this method significantly improves underwater image quality by addressing both high-and low-frequency distortions. Our extensive ablation studies and comparative evaluations consolidate the Dynamic SpectraFormer鈥檚 efficacy across multiple underwater image enhancement benchmarks. The source code is available at https://github.com/arifence2024/DynamicSpectraFormer.git.
