Search papers, labs, and topics across Lattice.
The study introduces the CLAIRE framework, a 15-item checklist and scoring system, designed to standardize the reporting and assessment of artificial intelligence (AI) models used in diagnostic imaging. The framework aims to improve reproducibility, clinical usability, and technical transparency of AI diagnostics, validated on a subset of 10 imaging studies. Internal validation showed significant improvement in inter-rater reliability after calibration, suggesting the framework's potential to enhance consistency in AI reporting.
The CLAIRE framework offers a standardized approach to evaluating AI diagnostic imaging studies, potentially improving the reliability and clinical applicability of these tools in orthopaedic practice.
Artificial intelligence (AI) models for diagnostic imaging face reproducibility challenges due to inconsistent reporting. Existing guidelines also lack specificity for imaging-based AI diagnostics, particularly regarding clinical usability and technical transparency. To address these gaps, the Completeness, Learnability, Applicability, Interpretability, Reproducibility, and Evaluation (CLAIRE) framework was developed as a practical reporting aid by a multidisciplinary team of clinicians and AI experts. CLAIRE was retrospectively validated on a subset of 10 imaging studies selected by theoretical saturation in medical and dental imaging. Internal validation demonstrated high reliability, with inter-rater agreement improving from Cohen's κ 0.286 to 0.987 (p < 0.01) after calibration, alongside a mean intra-rater reliability of 0.997 after a six-month washout period. This process yielded a 15-item structured checklist for standardising AI reporting, supported by an objective scoring system for quality categorisation and an editorial reference guide to facilitate systematic appraisal by reviewers and editors. CLAIRE aims to enhance clinician accessibility through plain-language technical summaries and assessments of real-world applicability. This proposal provides a unified and practical structure that improves reporting consistency, supports systematic assessment, and strengthens both reproducibility and clinical translation of AI-based imaging models.
