Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The study introduces SEGTME-UNI2, a comprehensive framework for multiclass cell segmentation and tumor microenvironment characterization using H&E-stained histology images. Central to this framework is the UNI2-UPERHOVER model, which employs a dual-head architecture for semantic segmentation and nuclear instance separation, trained through a novel three-stage progressive pseudo-label curriculum to enhance segmentation accuracy without relying on extensive pixel-level annotations. Results from preliminary validation on diverse datasets indicate that SEGTME-UNI2 effectively generates clinically interpretable narratives, paving the way for large-scale TME profiling in histopathology.
A novel framework achieves robust tumor microenvironment characterization from histology images by leveraging a dual-head segmentation model and a unique pseudo-labeling strategy.
Characterising the tumour microenvironment (TME) from routine H&E-stained histology images requires simultaneous cell segmentation, feature extraction, and interpretable clinical reporting. We present SEGTME-UNI2, a unified framework addressing these requirements. Its core is UNI2-UPERHOVER, a dual-head segmentation model pairing the UNI2-H pathology foundation model (ViT-Giant, pretrained on >100M tiles from 100K slides) with two parallel UperNet decoders: one for six-class semantic segmentation and one for horizontal-vertical gradient regression enabling watershed-based nuclear instance separation. To address the lack of pixel-level annotations in large real-world repositories, UNI2-UPERHOVER undergoes a three-stage progressive pseudo-label curriculum. Each stage trains a fresh model without weight transfer, driving improvement entirely via increased pseudo-label quality: Stage 1: Uses human-annotated PanNuke (7,901 images, 189,744 nuclei, 0.25 um/pixel). Stage 2: Uses entropy-filtered pseudo-labels from the Stage 1 model on 271,711 TCGA-UT scale-0 patches (0.5 um/pixel). Stage 3: Uses pseudo-labels from the Stage 2 model on all 1,608,060 TCGA-UT patches across six resolution scales (0.5-1.0 um/pixel). Segmentation outputs feed a structured TME feature extraction pipeline computing 20+ per-patch compositional, morphological, spatial entropy, and intercellular distance metrics. These are encoded as JSON and passed to a fine-tuned NVIDIA BioNeMo GPT model to generate clinically interpretable TME narratives. Preliminary validation on held-out PanNuke and TCGA-UT partitions demonstrates framework feasibility and internal consistency. The pseudo-labelled TCGA-UT dataset and UNI2-UPERHOVER checkpoint are publicly released to support large-scale TME profiling and spatial biology research.