Search papers, labs, and topics across Lattice.
This study benchmarks six unsupervised image-to-image architectures for AI-based virtual staining of liver fibrosis, specifically generating Sirius Red (SR) images from Hematoxylin and Eosin (H&E) stained images. By evaluating these models across 54 scaling configurations on a newly released paired dataset, the authors reveal significant differences in perceptual quality, task-specific error, and epistemic uncertainty, emphasizing that no single metric can adequately capture model performance. The findings highlight the necessity of a multi-faceted evaluation approach for reliable virtual staining, ultimately contributing to better diagnostic tools in clinical settings.
No single metric can determine the best model for virtual staining; a multi-dimensional evaluation is essential for reliable AI-based histological analysis.
Liver fibrosis, the principal predictor of long-term outcome in chronic liver disease, is staged from histological estimates of collagen content. Sirius Red (SR) provides the standard quantitative readout (collagen proportionate area, CPA) but is not acquired at every clinical centre and consumes tissue, time, and reagent cost beyond the routine Hematoxylin and eosin (H&E) stain. AI-based virtual staining can generate SR directly from H&E, yet systematic benchmarks of unsupervised models are scarce and their predictive uncertainty has not been quantified, even though visually plausible outputs may not faithfully reproduce the underlying tissue structure. We therefore benchmark six unsupervised image-to-image architectures (GAN-based and diffusion-based) across 54 scaling configurations on a newly released paired H&E to SR mouse liver dataset, the first open resource for this translation task. Each configuration is evaluated jointly on perceptual, distributional, and task-specific axes plus a blinded expert reader study; the best per family is then retrained as a deep ensemble, the first systematic comparison of epistemic uncertainty across unsupervised stain-to-stain architectures. Across families, perceptual quality, task-specific error, and ensemble agreement measure largely independent axes of model fitness: GAN-based methods cluster tightly on perceptual metrics yet differ substantially on task error and ensemble agreement, while the diffusion-based method (CycleDiffusion) is qualitatively different on all three. No single metric captures these differences, so reliable virtual staining requires reporting and selecting on all three jointly. The dataset, tiling pipeline, models, and evaluation code are released publicly.