Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces TAPE, a two-stage parameter-efficient fine-tuning framework to adapt foundation models for OCT/OCTA image analysis. TAPE decouples adaptation into domain alignment via masked image modeling with PEFT and task fitting for downstream segmentation. Experiments on retinal layer segmentation demonstrate that TAPE achieves state-of-the-art generalization performance with improved parameter efficiency compared to existing transfer learning approaches.
Domain alignment via masked image modeling with parameter-efficient fine-tuning unlocks surprisingly effective transfer learning for medical image segmentation with foundation models.
Automated analysis of optical coherence tomography (OCT) and OCT angiography (OCTA) images is critical for robust ophthalmic diagnosis. Existing mainstream methods trained from scratch rely heavily on massive data and model scale, thereby hindering their practical deployment in resource-constrained clinical settings. Although transfer learning based on foundation models (FMs) is promising, it still faces significant challenges: domain shift and task misalignment. To address these, we propose TAPE: A Two-stage Adaptation Framework via Parameter-Efficient Fine-tuning, which strategically decouples adaptation into domain alignment and task fitting for downstream segmentation. The domain adaptation stage notably applies parameter-efficient fine-tuning (PEFT) in the context of masked image modeling for medical image domain adaptation, a novel approach to the best of our knowledge. Applying TAPE to retinal layer segmentation on both universal (masked auto-encoder, MAE) and specialized (RETFound) FMs, it demonstrates superior parameter efficiency and achieves state-of-the-art generalization performance across diverse pathologies.