Search papers, labs, and topics across Lattice.
The paper introduces Pix2Rep-v2, a self-supervised learning framework designed for efficient representation learning in dense medical imaging tasks. By employing a redundancy reduction objective and leveraging equivariance principles, Pix2Rep-v2 achieves significant improvements in data efficiency for few-shot applications across various datasets and modalities. The method outperforms fully supervised baselines, achieving a notable +9.3 Dice points in one-shot segmentation on the M&Ms-2 dataset, demonstrating its effectiveness in real-world medical imaging scenarios.
Pix2Rep-v2 achieves remarkable data efficiency in dense medical imaging, outperforming fully supervised methods even in few-shot settings.
Dense self-supervised learning (SSL) is a powerful paradigm for learning without annotations the local descriptors required to solve dense medical imaging tasks. We present Pix2Rep-v2, a framework for SSL of pixel- and voxel-level representations suitable for few-shot downstream applications. Pix2Rep-v2 addresses the main challenges of dense SSL by leveraging a redundancy reduction objective at the pixel-level with a principle of equivariance of dense representations, that scales efficiently to 3D or wide field-of-view applications. We evaluate our method on four datasets, across multiple tasks, multiple modalities and anatomical structures using multiple backbones in 2D and 3D, and under various data regimes. As an alternative to linear probing or full fine-tuning on the downstream task, we also propose an in-context variant, without downstream training, based on a dense prototype approach. Pix2Rep-v2 shows substantially higher data-efficiency in few-shot scenarios compared to fully supervised baselines, and is competitive with the state-of-the-art e.g., +9.3 Dice points in one-shot segmentation on the M&Ms-2 dataset. Our code and pre-trained models are publicly available at https://github.com/BioMedTP/pix2rep-v2.
