Plus Disease in Retinopathy of Prematurity: A Continuous Spectrum of Vascular Abnormality as a Basis of Diagnostic Variability

详细信息    查看全文

• 作者：J. Peter Campbell ; MD ; MPH¹ ; ^&lowast ; ; Jayashree Kalpathy-Cramer ; PhD² ; ^&lowast ; ; Deniz Erdogmus ; PhD³ ; Peng Tian ; BE³ ; Dharanish Kedarisetti ; MSc³ ; Chace Moleta ; MS¹ ; James D. Reynolds ; MD⁴ ; Kelly Hutcheson ; MD⁵ ; Michael J. Shapiro ; MD⁶ ; Michael X. Repka ; MD ; MBA⁷ ; Philip Ferrone ; MD⁸ ; Kimberly Drenser ; MD⁹ ; Jason Horowitz ; MD¹⁰ ; Kemal Sonmez ; PhD¹¹ ; Ryan Swan ; BS¹¹ ; Susan Ostmo ; MS¹ ; Karyn E. Jonas ; RN¹² ; R.V. Paul Chan ; MD¹² ; Michael F. Chiang ; MD¹ ; ¹¹ ; ^{chiangm@ohsu.edu" class="auth_mail" title="E-mail the corresponding author} ; on behalf of the Imaging ; Informatics in Retinopathy of Prematurity Research ConsortiumMichael F. Chiang ; MD ; Susan Ostmo ; MS ; Kemal Sonmez ; PhD ; J. Peter Campbell ; MD ; MPH ; R.V. Paul Chan ; MD ; Karyn Jonas ; RN ; Jason Horowitz ; MD ; Osode Coki ; RN ; Cheryl-Ann Eccles ; RN ; Leora Sarna ; RN ; Audina Berrocal ; MD ; Catherin Negron ; BA ; Kimberly Denser ; MD ; Kristi Cumming ; RN ; Tammy Osentoski ; RN ; Tammy Check ; RN ; Mary Zajechowski ; RN ; Thomas Lee ; MD ; Evan Kruger ; BA ; Kathryn McGovern ; MPH ; Charles Simmons ; MD ; Raghu Murthy ; MD ; Sharon Galvis ; NNP ; Jerome Rotter ; MD ; Ida Chen ; PhD ; Xiaohui Li ; MD ; Kent Taylor ; PhD ; Kaye Roll ; RN ; Jayashree Kalpathy-Cramer ; PhD ; Deniz Erdogmus ; PhD ; Maria Ana Martinez-Castellanos ; MD ; Samantha Salinas-Longoria ; MD ; Rafael Romero ; MD ; Andrea Arriola ; MD ; Francisco Olguin-Manriquez ; MD ; Miroslava Meraz-Gutierrez ; MD ; Carlos M. Dulanto-Reinoso ; MD ; Cristina Montero-Mendoza ; MD
• 关键词：ANOVA ; analysis of variance ; CC ; correlation coefficient ; ETROP ; Early Treatment for Retinopathy of Prematurity ; ICROP ; International Classification of Retinopathy of Prematurity ; i-ROP ; Imaging and Informatics in Retinopathy of Prematurity ; ROP ; retinopathy of prematurity ; RSD ; reference standard diagnosis
• 刊名：Ophthalmology
• 出版年：2016
• 出版时间：November 2016
• 年：2016
• 卷：123
• 期：11
• 页码：2338-2344
• 全文大小：823 K

文摘

To identify patterns of interexpert discrepancy in plus disease diagnosis in retinopathy of prematurity (ROP).

ec_2">Design

We developed 2 datasets of clinical images as part of the Imaging and Informatics in ROP study and determined a consensus reference standard diagnosis (RSD) for each image based on 3 independent image graders and the clinical examination results. We recruited 8 expert ROP clinicians to classify these images and compared the distribution of classifications between experts and the RSD.

ec_3">Participants

Eight participating experts with more than 10 years of clinical ROP experience and more than 5 peer-reviewed ROP publications who analyzed images obtained during routine ROP screening in neonatal intensive care units.

ec_4">Methods

Expert classification of images of plus disease in ROP.

ec_5">Main Outcome Measures

Interexpert agreement (weighted κ statistic) and agreement and bias on ordinal classification between experts (analysis of variance [ANOVA]) and the RSD (percent agreement).

ec_6">Results

There was variable interexpert agreement on diagnostic classifications between the 8 experts and the RSD (weighted κ, 0–0.75; mean, 0.30). The RSD agreement ranged from 80% to 94% for the dataset of 100 images and from 29% to 79% for the dataset of 34 images. However, when images were ranked in order of disease severity (by average expert classification), the pattern of expert classification revealed a consistent systematic bias for each expert consistent with unique cut points for the diagnosis of plus disease and preplus disease. The 2-way ANOVA model suggested a highly significant effect of both image and user on the average score (dataset A: <em>Pem> < 0.05 and adjusted <em>Rem>² = 0.82; and dataset B: <em>Pem> < 0.05 and adjusted <em>Rem>² = 0.6615).

ec_7">Conclusions

There is wide variability in the classification of plus disease by ROP experts, which occurs because experts have different cut points for the amounts of vascular abnormality required for presence of plus and preplus disease. This has important implications for research, teaching, and patient care for ROP and suggests that a continuous ROP plus disease severity score may reflect more accurately the behavior of expert ROP clinicians and may better standardize classification in the future.