Search papers, labs, and topics across Lattice.
The paper introduces SpecDepth, a parameter-efficient adaptation framework for monocular depth estimation in colonoscopy, addressing the statistical shift in the frequency domain between natural images and colonoscopy images. SpecDepth employs an adaptive spectral rectification module using learnable wavelet decomposition to amplify attenuated high-frequency components in feature maps, thereby realigning the input signal with the pre-trained model's inductive bias. Experiments on C3VD and SimCol3D datasets demonstrate state-of-the-art performance, achieving absolute relative errors of 0.022 and 0.027, respectively, highlighting the effectiveness of directly addressing spectral mismatches for adapting foundation models to medical imaging.
By explicitly amplifying high-frequency components, SpecDepth achieves state-of-the-art depth estimation in colonoscopy, revealing that spectral mismatch, not semantic gap, is the key bottleneck when adapting foundation models to medical imaging.
Accurate monocular depth estimation is critical in colonoscopy for lesion localization and navigation. Foundation models trained on natural images fail to generalize directly to colonoscopy. We identify the core issue not as a semantic gap, but as a statistical shift in the frequency domain: colonoscopy images lack the strong high-frequency edge and texture gradients that these models rely on for geometric reasoning. To address this, we propose SpecDepth, a parameter-efficient adaptation framework that preserves the robust geometric representations of the pre-trained models while adapting to the colonoscopy domain. Its key innovation is an adaptive spectral rectification module, which uses a learnable wavelet decomposition to explicitly model and amplify the attenuated high-frequency components in feature maps. Different from conventional fine-tuning that risks distorting high-level semantic features, this targeted, low-level adjustment realigns the input signal with the original inductive bias of the foundational model. On the public C3VD and SimCol3D datasets, SpecDepth achieved state-of-the-art performance with an absolute relative error of 0.022 and 0.027, respectively. Our work demonstrates that directly addressing spectral mismatches is a highly effective strategy for adapting vision foundation models to specialized medical imaging tasks. The code will be released publicly after the manuscript is accepted for publication.
