How do trained raters take context factors into account when assessing GP trainee communication performance? An exploratory, qualitative study
详细信息    查看全文
  • 作者：Geurt Essers (1) (2)
    Patrick Dielissen (2)
    Chris van Weel (2) (3)
    Cees van der Vleuten (2) (4) (5) (6)
    Sandra van Dulmen (2) (7) (8)
    Anneke Kramer (2)

    1. Department of Public Health and Primary Care     ; Leiden University Medical Centre ; Hippocratespad 21 ; 2333 ZP ; Leiden ; The Netherlands
    2. Department of Primary and Community Care     ; Radboud University Medical Centre ; Nijmegen ; The Netherlands
    3. Australian Primary Health Care Research Institute     ; Australian National University ; Canberra ; Australia
    4. Department of Educational Development and Research     ; Maastricht University ; Maastricht ; The Netherlands
    5. Northumbria University     ; Newcastle upon Tyne ; UK
    6. Copenhagen University     ; Copenhagen ; Denmark
    7. NIVEL (Netherlands Institute for Health Services Research)     ; Utrecht ; The Netherlands
    8. Department of Health Science     ; Buskerud University College ; Drammen ; Norway
  • 关键词：Communication ; Context ; Assessment ; General practice
  • 刊名：Advances in Health Sciences Education
  • 出版年：2015
  • 出版时间：March 2015
  • 年：2015
  • 卷：20
  • 期：1
  • 页码：131-147
  • 全文大小：215 KB
  • 参考文献：1. Ander, D. S., Wallenstein, J., Abramson, J. L., Click, L., & Shayne, P. (2012). Reporter-interpreter-manager-educator (RIME) descriptive ratings as an evaluation tool in an emergency medicine clerkship. / The Journal of Emergency Medicine, / 43, 720鈥?27. CrossRef
    2. Bensing, J., van Dulmen, S., & Tates, K. (2003). Communication in context: New directions in communication research. / Patient Education and Counseling, / 50, 27鈥?2. CrossRef
    3. Brown, R. F., & Bylund, C. L. (2008). Communication skills training: Describing a new conceptual model. / Academic Medicine, / 83, 37鈥?4. CrossRef
    4. Chan, C. S., Wun, Y. T., Cheung, A., Dickinson, J. A., Chan, K. W., et al. (2003). Communication skill of general practitioners: Any room for improvement? How much can it be improved? / Medical Education, / 37, 514鈥?26. CrossRef
    5. Claramita, M., Dalen, J. V., & Van Der Vleuten, C. P. (2011). Doctors in a Southeast Asian country communicate sub-optimally regardless of patients鈥?educational background. / Patient Education and Counseling, / 85, e169鈥揺174. CrossRef
    6. Claramita, M., Nugraheni, M. D. F., van Dalen, J., & van der Vleuten, C. (2013). Doctor-patient communication in Southeast Asia: A different culture? / Advances in Health Sciences Education, / 18, 15鈥?1. CrossRef
    7. Crossley, J., & Davies, H. (2005). Doctors鈥?consultations with children and their parents: A model of competencies, outcomes and confounding influences. / Medical Education, / 39, 807鈥?19. CrossRef
    8. Crossley, J., Johnson, G., Booth, J., & Wade, W. (2011). Good questions, good answers: Construct alignment improves the performance of workplace-based assessment scales. / Medical Education, / 45, 560鈥?69. CrossRef
    9. de Haes, H., & Bensing, J. (2009). Endpoints in medical communication research, proposing a framework of functions and outcomes. / Patient Education and Counseling, / 74, 287鈥?94. CrossRef
    10. Durning, S., Artino, A. R., Jr, Pangaro, L., van der Vleuten, C. P., & Schuwirth, L. (2011). Context and clinical reasoning: Understanding the perspective of the expert鈥檚 voice. / Medical Education, / 45, 927鈥?38. CrossRef
    11. Essers, G., Kramer, A., Andriesse, B., van Weel, C., van der Vleuten, C. P. M., & van Dulmen, A. M. (2013a). Context factors in family physician communication鈥攑atient encounters and their impact on assessing communication skills鈥攁n exploratory study. / BMC Family Practice, / 14, 65. CrossRef
    12. Essers, G., van Dulmen, S., van Es, J., van Weel, C., van der Vleuten, C., Kramer, A. (2013b). Context factors in consultations of general practitioner trainees and their impact on communication assessment in the authentic setting. / Patient Education and Counseling. doi: 10.1016/j.pec.2013.08.024 . [Epub ahead of print].
    13. Essers, G., van Dulmen, S., van Weel, C., van der Vleuten, C., & Kramer, A. (2011). Identifying context factors explaining physician鈥檚 low performance in communication assessment: An explorative study in general practice. / BMC Family Practice, / 12, 138. CrossRef
    14. Eva, K. W. (2003). On the generality of specificity. / Medical Education, / 37, 587鈥?88. CrossRef
    15. Glaser, B. G. (1965). The constant comparative method of qualitative-analysis. / Social Problems, / 12, 436鈥?45. CrossRef
    16. Govaerts, M. J. B., Schuwirth, L. W. T., Van der Vleuten, C. P. M., & Muijtjens, A. M. M. (2011). Workplace-based assessment: Effects of rater expertise. / Advances in Health Sciences Education, / 16, 151鈥?65. CrossRef
    17. Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough? An experiment with data saturation and variability. / Field Methods, / 18, 59鈥?2. CrossRef
    18. Hobma, S. O., Ram, P. M., Muijtjens, A. M. M., Grol, R., & van der Vleuten, C. P. M. (2004). Setting a standard for performance assessment of doctor-patient communication in general practice. / Medical Education, / 38, 1244鈥?252. CrossRef
    19. Hulsman, R. L. (2009). Shifting goals in medical communication. Determinants of goal detection and response formation. / Patient Education and Counseling, / 74, 302鈥?08. CrossRef
    20. Kogan, J. R., Conforti, L., Bernabeo, E., Iobst, W., & Holmboe, E. (2011). Opening the black box of clinical skills assessment via observation: A conceptual model. / Medical Education, / 45, 1048鈥?060. CrossRef
    21. Kramer, A. W. M., Dusman, H., Tan, L. H. C., Jansen, J. J. M., Grol, R., & van der Vleuten, C. P. M. (2004). Acquisition of communication skills in postgraduate training for general practice. / Medical Education, / 38, 158鈥?67. CrossRef
    22. Malau-Aduli, B. S. (2011). Exploring the experiences and coping strategies of international medical students. / BMC Medical Education, / 11, 40. CrossRef
    23. McGill, D. A., van der Vleuten, C. P. M., & Clarke, M. J. (2011). Supervisor assessment of clinical and professional competence of medical trainees: A reliability study using workplace data and a focused analytical literature review. / Advances in Health Sciences Education, / 16, 405鈥?25. CrossRef
    24. Pangaro, L. (1999). A new vocabulary and other innovations for improving descriptive in-training evaluations. / Academic Medicine, / 74, 1203鈥?207. CrossRef
    25. Pangaro, L., & ten Cate, O. (2013). Frameworks for learner assessment in medicine: AMEE Guide No. 78. / Medical Teacher, / 35, E1197鈥揈1210. 2159X.2013.788789" target="_blank" title="It opens in new window">CrossRef
    26. Pelgrim EAM. (2013). / Clarifying observation and assessment feedback in workplace- / based learning, chapter 7. Dissertation, Radboud UMC, Nijmegen. http://www.eampelgrim.nl/phd_thesis_pelgrim.pdf.
    27. Pelgrim, E. A. M., & Kramer, A. W. M. (2013). How can medical education benefit from the evidence on learners seeking and using feedback? / Medical Education, / 47, 225鈥?27. 2128" target="_blank" title="It opens in new window">CrossRef
    28. Pelgrim, E. A. M., Kramer, A. W. M., Mokkink, H. G. A., & van der Vleuten, C. P. M. (2012). The process of feedback in workplace-based assessment: Organisation, delivery, continuity. / Medical Education, / 46, 604鈥?12.
    29. Ram, P., Grol, R., Rethans, J. J., Schouten, B., van der Vleuten, C., & Kester, A. (1999). Assessment of general practitioners by video observation of communicative and medical performance in daily practice: Issues of validity, reliability and feasibility. / Medical Education, / 33, 447鈥?54. CrossRef
    30. Ram, P., van Thiel, J., & van Dalen, J. (2003). / MAAS-global manual 2000. Maastricht: Maastricht University.
    31. Ram, P., et al. (2011). / National assessment plan for the general practitioner specialty training. Utrecht: General Practitioner Specialty Training in the Netherlands.
    32. Reinders, M. E., Blankenstein, A. H., van Marwijk, H. W. J., Knol, D. L., Ram, P., et al. (2011). Reliability of consultation skills assessments using standardised versus real patients. / Medical Education, / 45, 578鈥?84. CrossRef
    33. Salmon, P., Mendick, N., & Young, B. (2011). Integrative qualitative communication analysis of consultation and patient and practitioner perspectives: Towards a theory of authentic caring in clinical relationships. / Patient Education and Counseling, / 82, 448鈥?54. CrossRef
    34. Salmon, P., & Young, B. (2011). Creativity in clinical communication: From communication skills to skilled communication. / Medical Education, / 45, 217鈥?26. CrossRef
    35. Tavares, W., & Eva, K. W. (2013). Exploring the impact of mental workload on rater-based assessments. / Advances in Health Sciences Education, / 18, 291鈥?03. CrossRef
    36. Tolsgaard, M. G., Arendrup, H., Lindhardt, B. O., Hillingso, J. G., Stoltenberg, M., & Ringsted, C. (2012). Construct validity of the reporter-interpreter-manager-educator structure for assessing students鈥?patient encounter skills. / Academic Medicine, / 87, 799鈥?06. CrossRef
    37. Tweed, M., & Ingham, C. (2010). Observed consultation: Confidence and accuracy of assessors. / Advances in Health Sciences Education, / 15, 31鈥?3. CrossRef
    38. van der Vleuten, C. P. M., & Schuwirth, L. W. T. (2005). Assessing professional competence: From methods to programmes. / Medical Education, / 39, 309鈥?17. CrossRef
    39. van der Vleuten, C. P. M., Schuwirth, L. W. T., Driessen, E. W., Dijkstra, J., Tigelaar, D., et al. (2012). A model for programmatic assessment fit for purpose. / Medical Teacher, / 34, 205鈥?14. 2159X.2012.652239" target="_blank" title="It opens in new window">CrossRef
    40. van Es, J., De Waard-Wieringa, M., & Visser, M. (2013). Differential growth in doctor-patient communication skills in GP trainees. / Medical Education, / 47, 691鈥?00. 2175" target="_blank" title="It opens in new window">CrossRef
    41. van Es, JM., Schrijver, CJW., Oberink, RHH., & Visser, MRM. (2012). Two-dimensional structure of the MAAS-Global rating list for consultation skills of doctors. / Medical Teacher, e1鈥揺6. doi:10.3109/0142159X.2012.709652 .
    42. van Thiel, J., Kraan, H. F., & Vleuten, C. (1991). Reliability and feasibility of measuring medical interviewing skills: The revised Maastricht History-Taking and Advice Checklist. / Medical Education, / 25(3), 224鈥?29. CrossRef
    43. Williams, R. G., Klamen, D. A., & McGaghie, W. C. (2003). Cognitive, social and environmental sources of bias in clinical performance ratings. / Teaching and Learning in Medicine, / 15, 270鈥?92. CrossRef
    44. Winefield, H. R., Murrell, T. G. C., Clifford, J. V., & Farmer, E. A. (1995). Process and outcomes in general practice consultations: Problems in defining high quality care. / Social Science & Medicine, / 41, 6. CrossRef
    45. Yeates, P., O鈥橬eill, P., & Mann, K. (2011). Examining the box鈥檚 contents. / Medical Education, / 45, 970鈥?72. CrossRef
    46. Yeates, P., O鈥橬eill, P., Mann, K., & Eva, K. (2012). Seeing the same thing differently: Mechanisms that contribute to assessor differences in directly-observed performance assessments. / Advances in Health Sciences. doi: 10.1007/s10459-012-9372-1 . [Epub ahead of print].
    47. Yeates, P., O鈥橬eill, P., Mann, K., & Eva, K. W. (2013). 鈥榊ou鈥檙e certainly relatively competent鈥? Assessor bias due to recent experiences. / Medical Education, / 47, 910鈥?22. CrossRef
    48. Zoppi, K., & Epstein, R. M. (2002). Is communication a skill? Communication behaviors and being in relation. / Family Medicine, / 34, 319鈥?24.
  • 刊物类别：Humanities, Social Sciences and Law
  • 刊物主题：Education
    Medical Education
  • 出版者：Springer Netherlands
  • ISSN：1573-1677
文摘
Communication assessment in real-life consultations is a complex task. Generic assessment instruments help but may also have disadvantages. The generic nature of the skills being assessed does not provide indications for context-specific behaviour required in practice situations; context influences are mostly taken into account implicitly. Our research questions are: 1. What factors do trained raters observe when rating workplace communication? 2. How do they take context factors into account when rating communication performance with a generic rating instrument? Nineteen general practitioners (GPs), trained in communication assessment with a generic rating instrument (the MAAS-Global), participated in a think-aloud protocol reflecting concurrent thought processes while assessing videotaped real-life consultations. They were subsequently interviewed to answer questions explicitly asking them to comment on the influence of predefined contextual factors on the assessment process. Results from both data sources were analysed. We used a grounded theory approach to untangle the influence of context factors on GP communication and on communication assessment. Both from the think-aloud procedure and from the interviews we identified various context factors influencing communication, which were categorised into doctor-related (17), patient-related (13), consultation-related (18), and education-related factors (18). Participants had different views and practices on how to incorporate context factors into the GP(-trainee) communication assessment. Raters acknowledge that context factors may affect communication in GP consultations, but struggle with how to take contextual influences into account when assessing communication performance in an educational context. To assess practice situations, raters need extra guidance on how to handle specific contextual factors.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址：北京市海淀区学院路29号 邮编：100083

电话：办公室：(+86 10)66554848；文献借阅、咨询服务、科技查新：66554700