Search papers, labs, and topics across Lattice.
The authors develop AlignCP to resolve the fundamental conflict between supervised few-shot adaptation and conformal calibration in medical vision-language models, where parameter updates break the exchangeability required for rigorous coverage. While existing transductive conformal methods avoid weight updates to maintain theoretical validity at the cost of downstream task accuracy, this framework enables standard supervised fine-tuning on scarce labeled support data. By reweighting calibration samples to align the one-dimensional nonconformity score distributions between the support set and unlabeled query set, the approach closes adaptation-induced coverage gaps without requiring test-time labels.
Supervised few-shot adaptation no longer has to break conformal prediction guarantees: aligning 1D nonconformity score distributions restores distribution-free calibration on unlabeled query sets without forcing practitioners to freeze model weights.
Uncertainty estimation for medical vision--language models (VLMs) using conformal prediction has gained increasing attention due to its distribution-free coverage guarantees. However, standard conformal prediction relies on exchangeability between calibration and test data and typically requires a sufficiently large calibration set to obtain reliable coverage. These assumptions are difficult to satisfy in few-shot transfer settings, where only a small labeled support set is available to adapt a pretrained VLM to a new medical task, while an unlabeled query set is used for evaluation. Supervised fine-tuning on the support set changes the model parameters and consequently shifts the nonconformity score distribution, breaking exchangeability between calibration and query samples and leading to unreliable coverage under distribution shift. Existing transductive conformal adaptation methods often preserve validity by avoiding supervised updates. While this helps maintain conformal assumptions, it underutilizes the scarce labeled support data and limits task adaptation, which is the primary objective in few-shot learning. In this setting, conformal prediction should serve as an uncertainty estimation layer that supports the adapted model, rather than preventing adaptation itself. To this end, we propose AlignCP, a framework that reconciles supervised few-shot adaptation with conformal uncertainty estimation under non-exchangeability. AlignCP learns a reweighted calibration distribution that reduces the score-level discrepancy between the labeled support set and the unlabeled query set. By aligning the one-dimensional nonconformity score distributions, AlignCP aims to close the coverage gap induced by adaptation without requiring query labels.
