Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
AdaLoRA-QAT is introduced as a two-stage fine-tuning framework for CXR segmentation, combining adaptive low-rank encoder adaptation and quantization-aware training. This approach adaptively allocates rank to improve parameter efficiency and uses mixed-precision INT8 quantization to maintain structural fidelity. Experiments on large CXR datasets show that AdaLoRA-QAT achieves 95.6% Dice, matching full-precision SAM decoder fine-tuning, while reducing trainable parameters by 16.6x and model size by 2.24x, with no significant degradation in segmentation accuracy after quantization.
Achieve comparable segmentation accuracy to full-precision models with 16.6x fewer trainable parameters and 2.24x model compression by intelligently combining low-rank adaptation and quantization.
Chest X-ray (CXR) segmentation is an important step in computer-aided diagnosis, yet deploying large foundation models in clinical settings remains challenging due to computational constraints. We propose AdaLoRA-QAT, a two-stage fine-tuning framework that combines adaptive low-rank encoder adaptation with full quantization-aware training. Adaptive rank allocation improves parameter efficiency, while selective mixed-precision INT8 quantization preserves structural fidelity crucial for clinical reliability. Evaluated across large-scale CXR datasets, AdaLoRA-QAT achieves 95.6% Dice, matching full-precision SAM decoder fine-tuning while reducing trainable parameters by 16.6\times and yielding 2.24\times model compression. A Wilcoxon signed-rank test confirms that quantization does not significantly degrade segmentation accuracy. These results demonstrate that AdaLoRA-QAT effectively balances accuracy, efficiency, and structural trust-worthiness, enabling compact and deployable foundation models for medical image segmentation. Code and pretrained models are available at: https://prantik-pdeb.github.io/adaloraqat.github.io/