The OSCAR-MP Consensus Criteria for Quality Assessment of Retinal Optical Coherence Tomography Angiography

Abstract

Consensus; Angiography; Retina

Consenso; Angiografía; Retina

Consens; Angiografia; Retina

Background and Objectives Optical coherence tomography angiography (OCTA) is a noninvasive high-resolution imaging technique for assessing the retinal vasculature and is increasingly used in various ophthalmologic, neuro-ophthalmologic, and neurologic diseases. To date, there are no validated consensus criteria for quality control (QC) of OCTA. Our study aimed to develop criteria for OCTA quality assessment. Methods To establish criteria through (1) extensive literature review on OCTA artifacts and image quality to generate standardized and easy-to-apply OCTA QC criteria, (2) application of OCTA QC criteria to evaluate interrater agreement, (3) identification of reasons for interrater disagreement, revision of OCTA QC criteria, development of OCTA QC scoring guide and training set, and (4) validation of QC criteria in an international, interdisciplinary multicenter study. Results We identified 7 major aspects that affect OCTA quality: (O) obvious problems, (S) signal strength, (C) centration, (A) algorithm failure, (R) retinal pathology, (M) motion artifacts, and (P) projection artifacts. Seven independent raters applied the OSCAR-MP criteria to a set of 40 OCTA scans from people with MS, Sjogren syndrome, and uveitis and healthy individuals. The interrater kappa was substantial (κ 0.67). Projection artifacts were the main reason for interrater disagreement. Because artifacts can affect only parts of OCTA images, we agreed that prior definition of a specific region of interest (ROI) is crucial for subsequent OCTA quality assessment. To enhance artifact recognition and interrater agreement on reduced image quality, we designed a scoring guide and OCTA training set. Using these educational tools, 23 raters from 14 different centers reached an almost perfect agreement (κ 0.92) for the rejection of poor-quality OCTA images using the OSCAR-MP criteria. Discussion We propose a 3-step approach for standardized quality control: (1) To define a specific ROI, (2) to assess the occurrence of OCTA artifacts according to the OSCAR-MP criteria, and (3) to evaluate OCTA quality based on the occurrence of different artifacts within the ROI. OSCAR-MP OCTA QC criteria achieved high interrater agreement in an international multicenter study and is a promising QC protocol for application in the context of future clinical trials and studies.

R. Wicklein received an intramural research grant from the Technical University of Munich, School of Medicine, and was supported by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy within the framework of the Munich Cluster for Systems Neurology (EXC-2145 - SyNergy ID 390857198). C. Yam's PhD fellowship is funded by the UCL Queen Square Institute of Neurology and Cleveland Clinic London PhD Neuroscience Fellowship. C. Noll received a research scholarship from the Gemeinnützige Hertie Foundation. L. Aly received travel and research support by Novartis. N. Banze received no funding. E. Feodora Romahn received no funding. E. Wolf received no funding. Bernhard Hemmer received funding for the study by the European Union's Horizon 2020 Research and Innovation Program [grant MultipleMS, EU RIA 733161] and the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) under Germany's Excellence Strategy within the framework of the Munich Cluster for Systems Neurology [EXC 2145 SyNergy - ID 390857198]. F.C. Oertel received research support by the National MS Society, American Academy of Neurology and Hertie foundation, all outside of the submitted work. H.G. Zimmermann received intramural funding from the Berlin Center for Translational Vascular Biomedicine (VasBioBerlin). P. Albrecht received no funding. M. Ringelstein received no funding. C. Baumann has no financial disclosures and no conflicting relationship. N. Feucht received no funding. J. Penkava received no funding. J. Havla reports grants from the Friedrich-Baur-Stiftung, Merck, and Horizon. C. Mardin is a medical advisor to Heidelberg Engineering, Heidelberg, Germany, receives lecture honorarium by Heidelberg Engineering, Bayer AG, Leverkusen, Germany, and is partially funded by Federal Ministry of Education and Research and Bavarian Ministry of Health. J.A. Gernert received a research grant from the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation; SFB/TRR 274, ID 408885537). E. Vasileiou did not receive any funding. A. van der Walt did not receive any funding. O. Al-Louzi did not receive any funding. S. Cabello did not receive any funding. A. Vidal-Jordana has received support for contracts Juan Rodes (JR16/00024) and from Fondo de Investigación en Salud (PI17/02162 and PI22/01589) from Instituto de Salud Carlos III, Spain. J. Krämer did not receive any funding. Heinz Wiendl did not receive any funding. J.L. Preiningerova was funded by Charles University Cooperation Program in Neuroscience, and General University Hospital in Prague project MH CZ-DRO-VFN64165…. O. Ciccarelli was funded by NIHR RP-2017-08-ST2-004 and supported by researchers at the National Institute for Health and Care Research (NIHR) University College London Hospitals (UCLH) Biomedical Research Center (BRC) including OC. E. Garcia-Martin received grant support: PI20/00437 (Carlos III Health Institute) and Inflammatory Disease Network (RICORS) (RD21/0002/0050) (Carlos III Health Institute). V. Kana received funding from the Swiss National Foundation and a Filling the Gap protected research time grant (University of Zurich), all outside of the submitted work. P.A. Calabresi reports no funding. F. Paul reports no funding. S. Saidha reports no funding. A. Petzold reports no funding. A. Toosy is supported by recent awards from the MRC (MR/S026088/1), NIHR BRC (541/CAP/OC/818837) and RoseTrees Trust (A1332 and PGL21/10079), and MSIF. B. Knier was funded by the Else Kröner-Fresenius-Stiftung (Else Kröner-Fresenius Exzellenzstipendium 2019_EKES.09) and the Gemeinnützige Hertie Foundation (medMS program) and received a research award from Novartis.