Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Generative Embedding Translation (GET), a novel framework for medical image segmentation that translates image embeddings into mask embeddings within a frozen latent space of a Stable Diffusion VAE. By employing a U-Net-style architecture with Mobile Bottleneck Convolutions and Subsampled Self-Attention, GET achieves significant improvements in segmentation accuracy while being computationally efficient. The results demonstrate that GET outperforms existing generative, CNN, and Transformer baselines across five medical datasets, achieving notable enhancements in Dice and IoU metrics while using fewer parameters.
GET achieves superior medical image segmentation accuracy while reducing model complexity, outperforming state-of-the-art methods with fewer trainable parameters.
Generative segmentation provides an alternative to direct pixel-wise prediction by operating on learned latent representations, but effective image-to-mask translation must preserve target structure while remaining computationally efficient. We propose Generative Embedding Translation (GET), a structured embedding-translation framework that progressively transforms image embeddings into mask embeddings within the frozen latent space of a Stable Diffusion VAE. GET uses a U-Net-style Embedding Translation Network with 1.07M trainable parameters, combining Mobile Bottleneck Convolutions, Subsampled Self-Attention, and Multi-scale Feature Enrichment for local modeling, global context, and multi-scale refinement. Across five medical segmentation datasets, GET outperforms generative, CNN, and Transformer baselines. Compared with the strongest generative baseline, GMS, GET improves average Dice and IoU by 0.93% and 1.26%, reduces HD95 by 0.81 pixels, and uses 31.41% fewer trainable parameters. Under bidirectional BUS-BUSI domain shift, GET further improves Dice and IoU by 3.51% and 3.39%, while reducing HD95 by 27.37 pixels. Our code is available at: https://github.com/maklachur/GET.