Search papers, labs, and topics across Lattice.
This study introduces the REG 2025 benchmark and a clinically curated Pan-Asia dataset comprising approximately 10,500 whole-slide image (WSI) and report pairs to enhance automated pathology report generation. By evaluating various multimodal models, including pretrained vision-language models and hierarchical expert frameworks, the research reveals that superior performance is linked to structured report representations and effective multimodal grounding rather than VLM use alone. Key limitations identified include issues with quantitative attribute estimation and diagnostic overspecification, highlighting the need for improved methodologies in computational pathology.
Top-performing models in automated pathology rely on structured representations and hierarchical diagnostics, not just vision-language models alone.
The rapid advancement of vision-language models (VLMs) has accelerated progress in computational pathology; however, whole-slide image (WSI)-based pathology report generation remains limited by the scarcity of large-scale WSI--report datasets and the complexity of mapping spatially distributed visual patterns to structured clinical text. To address this, we introduce a clinically curated Pan-Asia WSI--report dataset of approximately 10,500 pairs from five institutions and establish the REG 2025 benchmark through a MICCAI challenge for systematic evaluation of multimodal models. We analyze submitted methods spanning pretrained VLMs, multiple-instance learning frameworks, hierarchical expert models, retrieval-augmented generation, and cross-modal Transformers. Rather than indicating that VLM use alone was sufficient for superior performance, the results suggest that top-performing methods benefited from structured report representations, hierarchical diagnostic decomposition, and effective multimodal grounding. We identify key limitations, including instability in quantitative attribute estimation (e.g., numeric hallucination) and a tendency toward diagnostic overspecification, with some errors resembling known diagnostic pitfalls in routine pathology. These findings establish REG 2025 as a benchmark for evaluating WSI-based structured report generation and vision-language understanding in computational pathology, providing insights for the design of clinically grounded multimodal pathology models.
