Search papers, labs, and topics across Lattice.
The paper introduces Prefer-DAS, a novel domain adaptation segmentation method for electron microscopy that leverages sparse point prompts and local human preferences as weak labels in the target domain. Prefer-DAS employs a promptable multitask model integrating self-training and prompt-guided contrastive learning to enable interactive segmentation with varying levels of point prompts. The method also introduces Local Preference Optimization (LPO) and Unsupervised Preference Optimization (UPO) to align with spatially varying or missing human feedback, achieving performance comparable to supervised methods.
Forget expensive, fully-supervised EM segmentation: Prefer-DAS learns effectively from sparse prompts and local preferences, rivaling fully supervised performance while adapting to new domains.
Domain adaptive segmentation (DAS) is a promising paradigm for delineating intracellular structures from various large-scale electron microscopy (EM) without incurring extensive annotated data in each domain. However, the prevalent unsupervised domain adaptation (UDA) strategies often demonstrate limited and biased performance, which hinders their practical applications. In this study, we explore sparse points and local human preferences as weak labels in the target domain, thereby presenting a more realistic yet annotation-efficient setting. Specifically, we develop Prefer-DAS, which pioneers sparse promptable learning and local preference alignment. The Prefer-DAS is a promptable multitask model that integrates self-training and prompt-guided contrastive learning. Unlike SAM-like methods, the Prefer-DAS allows for the use of full, partial, and even no point prompts during both training and inference stages and thus enables interactive segmentation. Instead of using image-level human preference alignment for segmentation, we introduce Local direct Preference Optimization (LPO) and sparse LPO (SLPO), plug-and-play solutions for alignment with spatially varying human feedback or sparse feedback. To address potential missing feedback, we also introduce Unsupervised Preference Optimization (UPO), which leverages self-learned preferences. As a result, the Prefer-DAS model can effectively perform both weakly-supervised and unsupervised DAS, depending on the availability of points and human preferences. Comprehensive experiments on four challenging DAS tasks demonstrate that our model outperforms SAM-like methods as well as unsupervised and weakly-supervised DAS methods in both automatic and interactive segmentation modes, highlighting strong generalizability and flexibility. Additionally, the performance of our model is very close to or even exceeds that of supervised models.
