Search papers, labs, and topics across Lattice.
This study introduces UnCapsTSR, an unsupervised transformer-based GAN framework designed to enhance the spatial resolution of low-resolution images obtained from Wireless Capsule Endoscopy (WCE). By eliminating the need for true low-resolution to high-resolution pairs and employing a Bilateral Total Variation loss for spatial continuity, the method significantly improves image quality without requiring explicit degradation estimation. The results show a remarkable 40 to 80 percent improvement in the newly proposed Endoscopy Quality Metric across various datasets, outperforming existing unsupervised super-resolution techniques.
UnCapsTSR achieves up to 80% improvement in image quality for capsule endoscopy, transforming how we visualize gastrointestinal health.
Wireless Capsule Endoscopy (WCE) captures and streams video while passing through a patient's Gastrointestinal (GI) tract and is used to examine its irregularities. Although advantageous over conventional endoscopy, WCE suffers from limitations related to capsule size and wireless transmission, resulting in images with coarser resolution. This work presents UnCapsTSR, an unsupervised transformer-based Generative Adversarial Network (GAN) framework for improving the spatial resolution of Low-Resolution (LR) WCE images. The proposed method accomplishes SR without explicit degradation estimation of real-world LR data and eliminates the need for true LR-HR pairs. UnCapsTSR employs a Bilateral Total Variation (BTV) loss to ensure spatial continuity in SR images. A newly curated dataset from the Kvasir Capsule dataset is also presented for training WCE SR models. Generalizability is validated on KID and GIANA datasets that are not used during training. A new non-reference metric, Endoscopy Quality Metric (EndoQM), is introduced for quantitative evaluation of domain-specific WCE data. Experiments demonstrate consistent improvement over state-of-the-art unsupervised SR approaches using NIQE, BRISQUE, PIQE, and EndoQM. Statistical evaluation shows 40 to 80 percent improvement in EndoQM from LR to SR across the evaluated datasets.
