Search papers, labs, and topics across Lattice.
The paper introduces PGVMS, a prompt-guided framework for virtual multiplex IHC staining from H&E images, addressing limitations in semantic guidance, staining distribution consistency, and spatial misalignment. PGVMS uses an adaptive prompt guidance mechanism with a pathological visual language model, a protein-aware learning strategy (PALS) to maintain protein expression patterns, and a prototype-consistent learning strategy (PCLS) to correct spatial misalignments. Experiments on two benchmark datasets demonstrate PGVMS's superior performance in pathological consistency, suggesting a shift towards unified virtual staining systems.
Achieve superior virtual multiplex IHC staining by prompting a visual language model with pathological insights, ensuring consistency across different stain modalities.
Immunohistochemical (IHC) staining enables precise molecular profiling of protein expression, with over 200 clinically available antibody-based tests in modern pathology. However, comprehensive IHC analysis is frequently limited by insufficient tissue quantities in small biopsies. Therefore, virtual multiplex staining emerges as an innovative solution to digitally transform H&E images into multiple IHC representations, yet current methods still face three critical challenges: (1) inadequate semantic guidance for multi-staining, (2) inconsistent distribution of immunochemistry staining, and (3) spatial misalignment across different stain modalities. To overcome these limitations, we present a prompt-guided framework for virtual multiplex IHC staining using only uniplex training data (PGVMS). Our framework introduces three key innovations corresponding to each challenge: First, an adaptive prompt guidance mechanism employing a pathological visual language model dynamically adjusts staining prompts to resolve semantic guidance limitations (Challenge 1). Second, our protein-aware learning strategy (PALS) maintains precise protein expression patterns by direct quantification and constraint of protein distributions (Challenge 2). Third, the prototype-consistent learning strategy (PCLS) establishes cross-image semantic interaction to correct spatial misalignments (Challenge 3). Evaluated on two benchmark datasets, PGVMS demonstrates superior performance in pathological consistency. In general, PGVMS represents a paradigm shift from dedicated single-task models toward unified virtual staining systems.
