Search papers, labs, and topics across Lattice.
This paper introduces a framework for enhancing the trustworthiness of super-resolution (SR) models in minimally invasive surgery by integrating a lightweight error-prediction network that assesses pixel-wise reconstruction errors. By employing Conformal Failure Masks (CFM), the method effectively identifies and localizes areas of unreliable SR output, ensuring that safety-critical applications can operate within defined error limits. The approach is validated through rigorous evaluations in endoscopic and robotic surgery contexts, marking a significant advancement in the reliability of real-time SR systems.
Trustworthy super-resolution in surgery is now achievable, with a model-agnostic method that identifies and mitigates unreliable reconstructions in real-time.
Super-resolution (SR) models are attracting growing interest for enhancing minimally invasive surgery and diagnostic videos under hardware constraints. However, valid concerns remain regarding the introduction of hallucinated structures and amplified noise, limiting their reliability in safety-critical settings. We propose a direct and practical framework to make SR systems more trustworthy by identifying where reconstructions are likely to fail. Our approach integrates a lightweight error-prediction network that operates on intermediate representations to estimate pixel-wise reconstruction error. The module is computationally efficient and low-latency, making it suitable for real-time deployment. We convert these predictions into operational failure decisions by constructing Conformal Failure Masks (CFM), which localize regions where the SR output should not be trusted. Built on conformal risk control principles, our method provides theoretical guarantees for controlling both the tolerated error limit and the miscoverage in detected failures. We evaluate our approach on image and video SR, demonstrating its effectiveness in detecting unreliable reconstructions in endoscopic and robotic surgery settings. To our knowledge, this is the first study to provide a model-agnostic, theoretically grounded approach to improving the safety of real-time endoscopic image SR.
ETH