国际学评教工具开发和使用的矛盾、对策及价值取向
|
摘要
通过对国际上各种新的学评教(SET)工具的共性和差异的分析,梳理出SET工具开发和使用中蕴含的八对矛盾,它们分别是:工具开发依据的理论内隐和理论外显的矛盾;教师中心和学生中心的矛盾;教学效能测量的单一维度和多重维度的矛盾;创新和保守之间的矛盾;及时性和全面性的矛盾;使用过程的匿名性和真实性之间的矛盾;工具开发过程中聚焦和延伸的矛盾;方法上的质性评价和量化评价的矛盾。在这几对矛盾问题上,持不同价值取向的研究者分别开发了各有特色的工具。在分析各种工具的适用性以及优缺点的基础上,得出SET的中心思路应该是教师的可控性。在教师可控性的前提下,文章对各种矛盾的表现及对策也做了探讨。
Through the analysis of the new international SET tools and their generality and differences,8 pairs of contradictions in the development and use of SET tools are combed.They are the "implicit or explicit" contradiction in the theory of tool development,the contradiction between the center of the teacher and that of the students,the contradiction between one-dimensional measurement of teaching effectiveness and the multiple dimensional measurement;the contradiction between innovation and conservatism;the contradiction between timeliness and comprehensiveness;the contradiction between the anonymity and the authenticity of the process;the contradiction between the focus and extension of the tool development process;and the contradiction between the qualitative evaluation and quantitative evaluation in the method.Considering these contradictory issues,researchers with different value orientations have developed tools of different traits.On the basis of analyzing the applicability and advantages and disadvantages of various tools,it is concluded that the central issue of SET should be its controllability to teachers.Under the premise of teachers' controllability,the article discusses the performance of various contradictions and the countermeasures.It is hoped that this article can provide reference for domestic scholars in developing and applying SET tools.
Through the analysis of the new international SET tools and their generality and differences,8 pairs of contradictions in the development and use of SET tools are combed.They are the "implicit or explicit" contradiction in the theory of tool development,the contradiction between the center of the teacher and that of the students,the contradiction between one-dimensional measurement of teaching effectiveness and the multiple dimensional measurement;the contradiction between innovation and conservatism;the contradiction between timeliness and comprehensiveness;the contradiction between the anonymity and the authenticity of the process;the contradiction between the focus and extension of the tool development process;and the contradiction between the qualitative evaluation and quantitative evaluation in the method.Considering these contradictory issues,researchers with different value orientations have developed tools of different traits.On the basis of analyzing the applicability and advantages and disadvantages of various tools,it is concluded that the central issue of SET should be its controllability to teachers.Under the premise of teachers' controllability,the article discusses the performance of various contradictions and the countermeasures.It is hoped that this article can provide reference for domestic scholars in developing and applying SET tools.
引文
[1]徐丹,熊艳青.元·科学·规范:美国高校学生评教制度管窥[J].大学教育科学,2016,157(3):102-107.
[2][9][20]Herbert W.Marsh.Students’Evaluations of University Teaching:Research Findings, Methodological Issues,and Directions for Future Research[J].International Journal of Educational Research,1987,11(3):253-388.
[3][7][10]Alan Socha.A Hierarchical Approach to Students’Assessments of Instruction[J].Assessment&Evaluation in Higher Education,2013,38(1):94-113.
[4][5]Engelland,Brian T.Making Effective Use of Student Evaluations to Improve Teaching Performance[J].Journal of Advancement of Marketing Education,2004,5(winter):38-46.
[6][54][73]Calvin Smith.Design-focused Evaluation[J].Assessment&Evaluation in Higher Education,2008,33(6):631-654.
[8]Poul Ramsden.Performance Indicator of Teaching Quality in Higher Education:The Course Experience Questionnaire[J].Studies in Higher Education,1991,16(2):129-149.
[11]Charles A.Burdsal,Paul D.Harrison.Further Evidence Supporting the Validity of Both a Multidimensional Profile and an Overall Evaluation of Teaching Effectiveness[J].Assessment&Evaluation in Higher Education,2008,33(5):567-576.
[12][66][74]M.S.Lemos et al.Development and Validation of a Theoretically Based, Multidimensional Questionnaire of Students’Evaluation of University Teaching[J].Assessment&Evaluation in Higher Education,2014,39(4):496-513.
[13][21]Pieter.Spooren,D.Mortelmans and J.Denekens.Student Evaluation of Teaching Quality in Higher Education:Development of Aninstrument Based on 10Likertscales[J].Assessment&Evaluation in Higher Education,2007,32(6):667-679.
[14][16][56][72]Martin Coffey,Graham Gibbs.Measuring Teachers’Repertoire of Teaching Methods[J].Assessment&Evaluation in Higher Education,2002,27(4):383-390.
[15][35]Twan Huybers.Student Evaluation of Teaching:The Use of Best–Worst Scaling[J].Assessment&Evaluation in Higher Education,2014,39(4):496-513.
[17][64]Beverley Oliver,et al.EVALUATE:An Evaluation Instrument for Measuring Students’Perceptions of their Engagement and Learning Outcomes[J].Assessment&Evaluation in Higher Education,2008,33(6):619-630.
[18][27][49][55][58]Theodore W.Frick et al.Improving Course Evaluations to Improve Instruction and Complex Learning in Higher Education[J].Educational Technology Research and Development,2010,58:115-136.
[19][68]Claus Nygaard,Dina Zoe Belluigi.A Proposed Methodology for Contextualised Evaluation in Higher Education[J].Assessment&Evaluation in Higher Education,2011,36(6):657-671.
[22][24][43][51]Pike,Cathy King.A Validation Study of an Instrument Designed to Measure Teaching Effectiveness[J].Journal of Social Work Education,1998,34(2):261-271.
[23][29]Fern Willits,Mark Brennan.Another Look at College Student’s Ratings of Course Quality:Data from Penn State Student Surveys in three Settings[J].Assessment&Evaluation in Higher Education,2017,42(3):443-462.
[25][28][32]John T.E.Richardson.Instruments for Obtaining Student Feedback:A Review of the Literature[J].Assessment&Evaluation in Higher Education,2005,30(4):387-415.
[26][36]Bert Brockx,et al.Taking the Grading Leniency Story to the Edge:The Influence of Student,Teacher,and Course Characteristics on Student Evaluations of Teaching in Higher Education[J].Educational Assessment Evaluation and Accountability,2011,23(4):289-306.
[30][46]Stephen Darwin.What Contemporary Work are Student Ratings Actually Doing in Higher Education?[J].Studies in Educational Evaluation,2017,54(3):13-21.
[31][33][37][40][41]Peter Burden.Does the Use of End of Semester Evaluation Forms Represent Teachers’Views of Teaching in a Tertiary Education Context in Japan?[J].Teaching and Teacher Education,2008,24(4):1463-1475.
[34]Anne Mai Walder.Pedagogical Innovation in Canadian Higher Education:Professor’Perspectives on its Effects on Teaching and Learning[J].Studies in Educational Evaluation,2017,54(3):71-82.
[38][44]Howard K.Wachtel.Student Evaluation of College Teaching Effectiveness:A Brief Review[J].Assessment&Evaluation in Higher Education,1998,23(2):191-212.
[39][57]Kathryn L.Combs et al.Enhancing Curriculum and Delivery:Linking Assessment to Learning Objectives[J].Assessment&Evaluation in Higher Education,2008,33(1):87-102.
[42][59]Lorna K.P.Suen et al.Students'Perceptions of the Effectiveness of Mentors in an Undergraduate Nursing Pogramme in Hong Kong[J].Journal of Advanced Nursing,2001,36(4):505-511.
[45]Lori R.Kogan et al.Student Evaluations of Teaching:Perceptions of Faculty Based on Gender,Position,and Rank[J]Teaching in Higher Education 2010,15(6):623-636.
[47]Herbert W.Marsh et al.Use of Student Ratings to Benchmark Universities:Multilevel Modeling of Responses to the Australian Course Experience Questionnaire(CEQ)[J].Journal of Educational Psychology,2011,103(3):733-748.
[48]Pieter Spooren,Wim Christiaens.I lLiked your cCourse Because I Believe in(the power of)Student Evaluations of Teaching(SET).Students’Perceptions of a Teaching Evaluation Process and their rRelationships with SET Scores?[J].Studies in Educational Evaluation,2017,54(3):43-49.
[50]Ruth Neumann.Communicating Student Evaluation of Teaching Results:Rating Interpretation Guides(RIGs)[J].Assessment&Evaluation in Higher Education,2000,25(2):121-134
[52]Mary W.Lindahl,Michael L.Unger.Cruelty in Student Teaching Evaluations[J].College Teaching,2010,58:71-76.
[53]Reynold Macpherson,Stanley Frielick.The Learning Improvement Strategies Questionnaire[J].International Studies in Educational Administration,2001,29(3):40-49.
[60][70][71]Grainne O’Donoghue,Catherine Doody,Tara Cusack.Using Student Centred Evaluation for Curriculum Enhancement:An Examination of Undergraduate Physiotherapy Education in Relation to Physical Activity and Exercise Prescription[J].Studies in Educational Evaluation,2011,37(5):170-176.
[61]Peter Gustafsson,Hans G.Eriksson.A Tool to Support Lecturers'Course Development at Introductory Undergraduate Level in Physics[J].Journal of Baltic Science Education,2017,16(1):56-63.
[62]Renée Stalmeijer et al.Strengthening Internal Quality Assurance Processes:Facilitating Student Evaluation Committees to Contribute[J].Assessment&Evaluation in Higher Education,2016,41(1):53-66.
[63]Karen Ellery.Multi-dimensional Evaluation for Module Improvement:A Mathematics-based Case Study[J].Assessment&Evaluation in Higher Education,2006,31(1):135-149.
[65]Tanya Beran et al.What Do Students Consider Useful about Student Ratings?[J].Assessment&Evaluation in Higher Education,2009,34(5):519-527.
[67]Nathan E.Gonyea,Joseph M.Gangi.Reining in Student Comments:A Model for Categorising and Studying Online Student Comments[J].Assessment&Evaluation in Higher Education,2012,37(1):45-55.
[69]Liesbeth Baartman,et al.Factors Influencing Assessment Quality in Higher Vocational Education[J].Assessment&Evaluation in Higher Education,2013,38(8):978-997.
[75]Bart Rienties.Understanding Academics’Resistance towards(online)Student Evaluation[J].Assessment&Evaluation in Higher Education,2014,39(8):987-1001.
[76]Herbert W.Marsh, Michael Bailey.Multidimensional Students’Evaluations of Teaching Effectiveness[J].The Journal of Higher Education,1993,64(1):1-18.
[2][9][20]Herbert W.Marsh.Students’Evaluations of University Teaching:Research Findings, Methodological Issues,and Directions for Future Research[J].International Journal of Educational Research,1987,11(3):253-388.
[3][7][10]Alan Socha.A Hierarchical Approach to Students’Assessments of Instruction[J].Assessment&Evaluation in Higher Education,2013,38(1):94-113.
[4][5]Engelland,Brian T.Making Effective Use of Student Evaluations to Improve Teaching Performance[J].Journal of Advancement of Marketing Education,2004,5(winter):38-46.
[6][54][73]Calvin Smith.Design-focused Evaluation[J].Assessment&Evaluation in Higher Education,2008,33(6):631-654.
[8]Poul Ramsden.Performance Indicator of Teaching Quality in Higher Education:The Course Experience Questionnaire[J].Studies in Higher Education,1991,16(2):129-149.
[11]Charles A.Burdsal,Paul D.Harrison.Further Evidence Supporting the Validity of Both a Multidimensional Profile and an Overall Evaluation of Teaching Effectiveness[J].Assessment&Evaluation in Higher Education,2008,33(5):567-576.
[12][66][74]M.S.Lemos et al.Development and Validation of a Theoretically Based, Multidimensional Questionnaire of Students’Evaluation of University Teaching[J].Assessment&Evaluation in Higher Education,2014,39(4):496-513.
[13][21]Pieter.Spooren,D.Mortelmans and J.Denekens.Student Evaluation of Teaching Quality in Higher Education:Development of Aninstrument Based on 10Likertscales[J].Assessment&Evaluation in Higher Education,2007,32(6):667-679.
[14][16][56][72]Martin Coffey,Graham Gibbs.Measuring Teachers’Repertoire of Teaching Methods[J].Assessment&Evaluation in Higher Education,2002,27(4):383-390.
[15][35]Twan Huybers.Student Evaluation of Teaching:The Use of Best–Worst Scaling[J].Assessment&Evaluation in Higher Education,2014,39(4):496-513.
[17][64]Beverley Oliver,et al.EVALUATE:An Evaluation Instrument for Measuring Students’Perceptions of their Engagement and Learning Outcomes[J].Assessment&Evaluation in Higher Education,2008,33(6):619-630.
[18][27][49][55][58]Theodore W.Frick et al.Improving Course Evaluations to Improve Instruction and Complex Learning in Higher Education[J].Educational Technology Research and Development,2010,58:115-136.
[19][68]Claus Nygaard,Dina Zoe Belluigi.A Proposed Methodology for Contextualised Evaluation in Higher Education[J].Assessment&Evaluation in Higher Education,2011,36(6):657-671.
[22][24][43][51]Pike,Cathy King.A Validation Study of an Instrument Designed to Measure Teaching Effectiveness[J].Journal of Social Work Education,1998,34(2):261-271.
[23][29]Fern Willits,Mark Brennan.Another Look at College Student’s Ratings of Course Quality:Data from Penn State Student Surveys in three Settings[J].Assessment&Evaluation in Higher Education,2017,42(3):443-462.
[25][28][32]John T.E.Richardson.Instruments for Obtaining Student Feedback:A Review of the Literature[J].Assessment&Evaluation in Higher Education,2005,30(4):387-415.
[26][36]Bert Brockx,et al.Taking the Grading Leniency Story to the Edge:The Influence of Student,Teacher,and Course Characteristics on Student Evaluations of Teaching in Higher Education[J].Educational Assessment Evaluation and Accountability,2011,23(4):289-306.
[30][46]Stephen Darwin.What Contemporary Work are Student Ratings Actually Doing in Higher Education?[J].Studies in Educational Evaluation,2017,54(3):13-21.
[31][33][37][40][41]Peter Burden.Does the Use of End of Semester Evaluation Forms Represent Teachers’Views of Teaching in a Tertiary Education Context in Japan?[J].Teaching and Teacher Education,2008,24(4):1463-1475.
[34]Anne Mai Walder.Pedagogical Innovation in Canadian Higher Education:Professor’Perspectives on its Effects on Teaching and Learning[J].Studies in Educational Evaluation,2017,54(3):71-82.
[38][44]Howard K.Wachtel.Student Evaluation of College Teaching Effectiveness:A Brief Review[J].Assessment&Evaluation in Higher Education,1998,23(2):191-212.
[39][57]Kathryn L.Combs et al.Enhancing Curriculum and Delivery:Linking Assessment to Learning Objectives[J].Assessment&Evaluation in Higher Education,2008,33(1):87-102.
[42][59]Lorna K.P.Suen et al.Students'Perceptions of the Effectiveness of Mentors in an Undergraduate Nursing Pogramme in Hong Kong[J].Journal of Advanced Nursing,2001,36(4):505-511.
[45]Lori R.Kogan et al.Student Evaluations of Teaching:Perceptions of Faculty Based on Gender,Position,and Rank[J]Teaching in Higher Education 2010,15(6):623-636.
[47]Herbert W.Marsh et al.Use of Student Ratings to Benchmark Universities:Multilevel Modeling of Responses to the Australian Course Experience Questionnaire(CEQ)[J].Journal of Educational Psychology,2011,103(3):733-748.
[48]Pieter Spooren,Wim Christiaens.I lLiked your cCourse Because I Believe in(the power of)Student Evaluations of Teaching(SET).Students’Perceptions of a Teaching Evaluation Process and their rRelationships with SET Scores?[J].Studies in Educational Evaluation,2017,54(3):43-49.
[50]Ruth Neumann.Communicating Student Evaluation of Teaching Results:Rating Interpretation Guides(RIGs)[J].Assessment&Evaluation in Higher Education,2000,25(2):121-134
[52]Mary W.Lindahl,Michael L.Unger.Cruelty in Student Teaching Evaluations[J].College Teaching,2010,58:71-76.
[53]Reynold Macpherson,Stanley Frielick.The Learning Improvement Strategies Questionnaire[J].International Studies in Educational Administration,2001,29(3):40-49.
[60][70][71]Grainne O’Donoghue,Catherine Doody,Tara Cusack.Using Student Centred Evaluation for Curriculum Enhancement:An Examination of Undergraduate Physiotherapy Education in Relation to Physical Activity and Exercise Prescription[J].Studies in Educational Evaluation,2011,37(5):170-176.
[61]Peter Gustafsson,Hans G.Eriksson.A Tool to Support Lecturers'Course Development at Introductory Undergraduate Level in Physics[J].Journal of Baltic Science Education,2017,16(1):56-63.
[62]Renée Stalmeijer et al.Strengthening Internal Quality Assurance Processes:Facilitating Student Evaluation Committees to Contribute[J].Assessment&Evaluation in Higher Education,2016,41(1):53-66.
[63]Karen Ellery.Multi-dimensional Evaluation for Module Improvement:A Mathematics-based Case Study[J].Assessment&Evaluation in Higher Education,2006,31(1):135-149.
[65]Tanya Beran et al.What Do Students Consider Useful about Student Ratings?[J].Assessment&Evaluation in Higher Education,2009,34(5):519-527.
[67]Nathan E.Gonyea,Joseph M.Gangi.Reining in Student Comments:A Model for Categorising and Studying Online Student Comments[J].Assessment&Evaluation in Higher Education,2012,37(1):45-55.
[69]Liesbeth Baartman,et al.Factors Influencing Assessment Quality in Higher Vocational Education[J].Assessment&Evaluation in Higher Education,2013,38(8):978-997.
[75]Bart Rienties.Understanding Academics’Resistance towards(online)Student Evaluation[J].Assessment&Evaluation in Higher Education,2014,39(8):987-1001.
[76]Herbert W.Marsh, Michael Bailey.Multidimensional Students’Evaluations of Teaching Effectiveness[J].The Journal of Higher Education,1993,64(1):1-18.