Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
To address the severe domain gap and annotation bottlenecks in high-resolution scientific imaging, the authors pretrain an in-domain Masked Autoencoder (MAE) with a Vision Transformer backbone on over 10 million multi-view plant image tiles. This directly targets the failure of generic natural-image foundation models to transfer fine-grained, dense representations under high pixel dimensions, multi-view shifts, and extreme label scarcity. Across diverse dense prediction benchmarks, the model attains a 0.8686 Mean Dice—outperforming a standard natural-image MAE baseline by nearly 7 points—while demonstrating consistent performance scaling with dataset size.
Off-the-shelf vision foundation models fail to transfer dense representations to scientific imagery, but scaling in-domain self-supervised pretraining across 10 million tiles delivers an immediate 7-point Dice improvement under severe annotation limits.
High-resolution plant imaging enables detailed characterization of plant morphology, but dense scientific analysis remains limited by costly pixel-level annotations, large image pixel dimensions, and substantial variation in imaging conditions. This work proposes a scalable in-domain self-supervised pretrained foundation model for high-resolution, high-pixel-dimension multi-species plant imagery. A masked autoencoder with a ViT backbone is pretrained on more than 10 million multi-view plant image tiles using distributed training. Following scalable pretraining, the learned foundation-model representations are comprehensively benchmarked across fine-grained dense prediction and coarse global feature recognition, with particular emphasis on limited supervision and realistic downstream imaging conditions. This work focuses on the domain gap of existing foundation models in dense feature representation and transfer. Through extensive experiments involving limited annotations, cross-view variation, and resolution degradation, the in-domain FM achieves a Mean Dice of 0.8686 and a Pooled Dice of 0.8959, outperforming an MAE counterpart pretrained on large-scale natural-image data by 0.0694 and 0.0613, respectively. The results further indicate that increasing pretraining scale produces consistent improvements in dense feature transfer. Overall, these findings suggest that scaling in-domain self-supervised pretraining can reduce the domain gap and improve transferable dense representations for high-pixel-dimension scientific imaging.