Systematic development of a proctor certification examination for the Fundamentals of Laparoscopic Surgery testing program

详细信息    查看全文

• 作者：E. Matthew Ritter ; M.D. ; F.A.C.S.^a ; ^{eritter@usuhs.edu" class="auth_mail" title="E-mail the corresponding author} ; Inga C. Brissman ; B.S.^b
• 关键词：Test development ; Validity evidence ; Assessment ; Fundamentals of laparoscopic surgery ; Certification examinationination ; Job task analysis
• 刊名：The American Journal of Surgery
• 出版年：2016
• 出版时间：February 2016
• 年：2016
• 卷：211
• 期：2
• 页码：458-463
• 全文大小：154 K

文摘

The fundamentals of laparoscopic surgery (FLS) examination is administered by proctors around the world. Inconsistent administration represents a threat to test validity. We systematically developed a test to assess the FLS proctors knowledge and skills relating to FLS test administration.

Methods

Downing's 12 steps for test development were used. subject matter expert's created a job and/or task analysis inventory of the knowledge and skills of an FLS proctor. Using the weighted blueprint, a 45 question examination was created using online testing software and piloted.

Results

The blueprint generated 38 job and/or task analysis items in 4 domains. Items on the test had an average content validity index of .9. The mean score during beta testing was 32 of 45 (71%). Reliability was good at .72. Mean item difficulty and discrimination were .71 and .28, respectively. The cut score was set at 62% resulting in a pass rate of 83%.

Conclusions

We developed a test representing the skills of the FLS proctor that demonstrates considerable validity evidence. Incorporation of this examination into proctor training should reduce the threats to validity for the FLS examination.