- 作者：Kamran ; Ahmed M.B.B.S. ; M.R.C.S. ; Danilo ; Miskovic M.D. ; F.R.C.S. ; Ara ; Darzi M.D. ; F.R.C.S. ; F.A.C.S. ; K.B.E. ; Thanos ; Athanasiou Ph.D. ; F.E.T.C.S. ; George B. ; Hanna Ph.D. ; F.R.C.S. ; ; ; g.hanna@imperial.ac.uk
- 关键词：Skills ; Assessment ; Training ; Observational ; Error ; Checklist
- 刊名：The American Journal of Surgery
- 出版年：2011
- 出版时间：October 2011
- 年：2011
- 卷：202
- 期：4
- 页码：469-480.e6
- 全文大小：2094 K
Background
Assessment by direct observation of procedural skills is an important source of constructive feedback. The aim of this study was to identify observational tools for technical skill assessment, to assess characteristics of these tools, and to assess their usefulness for assessment.Methods
Included studies reported tools for observational assessment of technical skills. A total of 106 articles were included.
Results
Three main categories included global assessment scales evaluating generic skills (n = 29), task-specific methods assessing procedure-specific skills (n = 30), and combinations of tools evaluating both generic and task-specific skills (n = 47). In most studies, content validity was not evaluated using an accepted scientific method. All tools were assessed for inter-rater reliability and construct validity. Data on feasibility, acceptability, and educational impact were sparse.
Conclusions
There is evidence of validity and reliability for observational assessment tools at the trainee level. In most studies a comprehensive analysis of the tools was not achieved. Evaluation of technical skill using current observational assessment tools is not reliable and valid at the specialist level. Future research needs to focus on further systematic tool development and analysis, especially at the specialist level.