Search papers, labs, and topics across Lattice.
This paper introduces a new multi-center, multi-resolution dataset for ulcerative colitis (UC) scoring in endoscopy, featuring expert-validated Mayo Endoscopic Score (MES) and Ulcerative Colitis Endoscopic Index of Severity (UCEIS) labels, along with detailed clinical descriptions. The dataset aims to address the lack of publicly available annotated data and robust benchmarking for computational methods predicting these scores. The authors benchmarked the dataset using CNNs, vision transformers, hybrid models, and vision-language captioning algorithms, establishing a baseline for future research.
Finally, a comprehensive, multi-center dataset with dual scoring metrics and expert-generated captions is available to advance clinically meaningful multimodal algorithms for ulcerative colitis scoring in endoscopy.
Ulcerative colitis (UC) is a chronic mucosal inflammatory condition that places patients at increased risk of colorectal cancer. Colonoscopic surveillance remains the gold standard for assessing disease activity, and reporting typically relies on standardised endoscopic scoring metrics. The most widely used is the Mayo Endoscopic Score (MES), with some centres also adopting the Ulcerative Colitis Endoscopic Index of Severity (UCEIS). Both are descriptive assessments of mucosal inflammation (MES: 0 to 3; UCEIS: 0 to 8), where higher values indicate more severe disease. However, computational methods for automatically predicting these scores remain limited, largely due to the lack of publicly available expert-annotated datasets and the absence of robust benchmarking. There is also a significant research gap in generating clinically meaningful descriptions of UC images, despite image captioning being a well-established computer vision task. Variability in endoscopic systems and procedural workflows across centres further highlights the need for multi-centre datasets to ensure algorithmic robustness and generalisability. In this work, we introduce a curated multi-centre, multi-resolution dataset that includes expert-validated MES and UCEIS labels, alongside detailed clinical descriptions. To our knowledge, this is the first comprehensive dataset that combines dual scoring metrics for classification tasks with expert-generated captions describing mucosal appearance and clinically accepted reasoning for image captioning. This resource opens new opportunities for developing clinically meaningful multimodal algorithms. In addition to the dataset, we also provide benchmarking using convolutional neural networks, vision transformers, hybrid models, and widely used multimodal vision-language captioning algorithms.
