Search papers, labs, and topics across Lattice.
This paper introduces HistDiT, a latent conditional Diffusion Transformer (DiT) architecture for high-fidelity virtual histological staining. HistDiT employs a dual-stream conditioning strategy, using VAE-encoded latents for spatial constraints and UNI embeddings for semantic phenotype guidance, along with a multi-objective loss function. The model is trained with a Structural Correlation Metric (SCM) to prioritize morphological structure, achieving state-of-the-art performance in generating realistic and structurally accurate virtual stains.
Virtual histological staining can now achieve unprecedented fidelity thanks to a novel diffusion transformer architecture that balances spatial constraints and semantic guidance.
Immunohistochemistry (IHC) is essential for assessing specific immune biomarkers like Human Epidermal growth-factor Receptor 2 (HER2) in breast cancer. However, the traditional protocols of obtaining IHC stains are resource-intensive, time-consuming, and prone to structural damages. Virtual staining has emerged as a scalable alternative, but it faces significant challenges in preserving fine-grained cellular structures while accurately translating biochemical expressions. Current state-of-the-art methods still rely on Generative Adversarial Networks (GANs) or standard convolutional U-Net diffusion models that often struggle with"structure and staining trade-offs". The generated samples are either structurally relevant but blurry, or texturally realistic but have artifacts that compromise their diagnostic use. In this paper, we introduce HistDiT, a novel latent conditional Diffusion Transformer (DiT) architecture that establishes a new benchmark for visual fidelity in virtual histological staining. The novelty introduced in this work is, a) the Dual-Stream Conditioning strategy that explicitly maintains a balance between spatial constraints via VAE-encoded latents and semantic phenotype guidance via UNI embeddings; b) the multi-objective loss function that contributes to sharper images with clear morphological structure; and c) the use of the Structural Correlation Metric (SCM) to focus on the core morphological structure for precise assessment of sample quality. Consequently, our model outperforms existing baselines, as demonstrated through rigorous quantitative and qualitative evaluations.
