Twenty-four colonoscopy or sigmoidoscopy videos were reviewed by 26 clinicians familiar with diagnosis and treatment of FAP. The reviewers independently assigned a stage to a case by using the proposed system and chose a stage-specific intervention for each case. Our endpoint was the degree of concordance among reviewers staging and intervention assessments.
The staging and intervention ratings of the 26 reviewers were highly concordant (ρ = 0.710; 95% credible interval, 0.651-0.759). Sixty-two percent of reviewers agreed on the FAP stage, and 90% of scores were within ±1 stage of the mode. Sixty percent of reviewers agreed on the intervention, and 86% chose an intervention within ±1 level of the mode.
The proposed FAP colon polyposis staging system and stage-specific intervention are based on a high degree of agreement on the part of experts in the review of individual cases of polyposis. Therefore, reliable and clinically relevant means for measuring trial outcomes can be developed. Outlier cases showing wide scatter in stage assignment call for individualized attention and may be inappropriate for enrollment in clinical trials for this reason.