Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a 3D foundation model for light sheet fluorescence microscopy (LSM) data, pretrained on a large, diverse dataset of 3D images using masked reconstruction and image-text alignment. The model learns transferable volumetric representations, significantly reducing the annotation burden for downstream tasks like segmentation, classification, and deblurring. Experiments demonstrate consistent performance improvements over baselines, validated by both standard metrics and expert assessments.
Unlock few-shot segmentation, classification, and deblurring in light sheet microscopy with a new 3D foundation model that slashes annotation needs.
Light sheet fluorescence microscopy (LSM) enables high-resolution, three-dimensional (3D) imaging of biological specimens, providing rich volumetric data for studying cellular organization, pathology, and vascular networks. However, the size, dimensionality, and annotation burden of LSM data make supervised deep learning approaches costly and difficult to scale. Additionally, despite the abundance of unannotated LSM volumes, foundation models for this modality remain underexplored due to computational challenges and the complexity of volumetric representation learning. In this work, we introduce a 3D foundation model for LSM data, pretrained on a large curated collection of 3D images spanning multiple organisms, stains, and imaging protocols. We learn transferable volumetric representations by jointly optimizing for masked reconstruction and image-text alignment. The pretrained backbone drastically reduces the annotation burden, enabling efficient, few-shot adaptation for varied downstream tasks. We evaluate this approach on downstream segmentation, classification, and deblurring. Our results demonstrate consistent improvements over baselines, (1) when measured using standard evaluation metrics and (2) when rigorously assessed by domain experts. This highlights the potential of foundation model pretraining to reduce annotation requirements while improving performance across diverse LSM analysis tasks. Pretrained model weights and code for pretraining and finetuning are publicly available: https://github.com/AdinaScheinfeld/lsm_fm_public_repo.git.