Search papers, labs, and topics across Lattice.
This paper addresses the critical issue of performance leakage in Federated Learning (FL) for surgical AI, where models selected based on validation data can fail to generalize to new institutions. The authors introduce GEN-Guard, a post-hoc framework that combines Generalization Detection via Client-Blocked Evaluation (CBE) and Generalization Correction through Disagreement-Aware Distillation (DAD) to enhance model robustness across diverse clinical settings. Evaluations on laparoscopic cholecystectomy and colonoscopy tasks show that GEN-Guard significantly mitigates Model Selection Failures (MSFs), improving in-federation F1 scores and unseen-institution performance by up to 3 points.
Performance leakage in federated surgical AI can exceed 80%, but GEN-Guard effectively corrects these failures, enhancing model robustness across institutions.
Federated Learning (FL) in surgical video AI enables collaborative model training without sharing sensitive data. However, standard evaluation practices - selecting the "best" global model based only on validation data from participating hospitals - can lead to suboptimal deployment choices. We identify this critical failure mode as performance leakage, where the selected model overfits internal federation data and fails to generalize to unseen institutions. We propose GEN-Guard, a practical post-hoc framework to detect and correct generalization failures in federated surgical AI. It integrates Generalization Detection via Client-Blocked Evaluation (CBE), which validates performance on isolated client distributions to prevent performance leakage, and Generalization Correction through Disagreement-Aware Distillation (DAD), which learns adaptive feature-level corrections for cross-institutional robustness. Both components operate after standard FL convergence while providing robust support for zero-shot adaptation to unseen environments. We first quantify the severity of performance leakage, observing Model Selection Failures (MSFs) exceeding 80% under standard evaluation. GEN-Guard is evaluated on two multi-center clinical challenges: surgical phase recognition in laparoscopic cholecystectomy and polyp segmentation in colonoscopy. Across both datasets, GEN-Guard consistently corrects these failures, improving in-federation F1 scores by up to 2 points, unseen-institution performance by up to 3 points, and worst-case institutional performance by 3-9 points. Performance leakage represents a systematic and previously under-recognized risk in federated surgical AI. GEN-Guard provides a practical solution for detecting and correcting such failures. By improving cross-institutional robustness and zero-shot generalization, it strengthens the reliability of FL for real-world surgical deployment.
