大学英语四级考试写作测评量表效度研究
|
摘要
本文以大学英语四级写作测试(简称CET-4写作测试)中采用的整体评分量表为例,采用混合研究设计方案,借助问卷和访谈调查了评分员对该量表的意见。研究结果表明:现有的CET-4写作评分量表在清晰度和可操作性方面基本令人满意,但在量表的完整性、提供的反馈信息以及量表在评分员培训中的作用这三个方面仍有较大的提升空间。根据研究结果,本文建议进一步运用实证研究方法为CET-4写作测试开发分项评分量表,以便为大学英语写作教学提供更加丰富的诊断性信息,确保考试对教学产生积极的后效和影响。
Taking the holistic rating scale currently adopted in the CET-4 writing assessment as an example,this study investigates how CET-4 raters perceives the scale through questionnaire survey and interviews. The results indicate that the rating scale adopted by the CET-4 writing is generally satisfactory in terms of its clarity and practicality; however,there remains much room for improvement with respect to its completeness,feedback,and usefulness in rater training. Therefore,the study proposes to develop an analytic rating scale for the CET-4 writing based on empirical studies so that it can provide more useful diagnostic information for college English teaching and learning,and exercise more positive washback.
Taking the holistic rating scale currently adopted in the CET-4 writing assessment as an example,this study investigates how CET-4 raters perceives the scale through questionnaire survey and interviews. The results indicate that the rating scale adopted by the CET-4 writing is generally satisfactory in terms of its clarity and practicality; however,there remains much room for improvement with respect to its completeness,feedback,and usefulness in rater training. Therefore,the study proposes to develop an analytic rating scale for the CET-4 writing based on empirical studies so that it can provide more useful diagnostic information for college English teaching and learning,and exercise more positive washback.
引文
AERA,APA & NCME. 2014. Standards for Educational and Psychological Testing [M]. Washington D. C: AERA.
Alderson,J.C,C.Clapham&D.Wall.1995.Language Test Construction and Evaluation[M].Cambridge:Cambridge University Press.
Bachman,L.F.&A.S.Palmer.1996.Language Testing in Practice:Designing and Developing Useful Language Tests[M].Oxford University Press.
Barrett,S.2001.The Impact of Training on Rater Variability[J].International Education Journal(1):49-58.
Chapelle,C.A.,Enright,M.K.&J.M.Jamieson.2008.Building a Validity Argument for the Test of English as a Foreign Language[M].New York:Routledge.
Chun,C.2008.Comments on“Evaluationof the Usefulness of the Versant for English Test:a Response”:the Author Responds[J].Language Assessment Quarterly(2):168-172.
Creswell,J.W.&V.L.P.Clark.2011.Designing and Conducting Mixed Methods Research[M].Sage publications.
Cumming,A.,Kantor,R.&D.Powers.2001.An Investigation into Raters’Decision-making,and Development of a Preliminary Analytic Framework for Scoring TOEFL Essays and TOEFL 2000 Prototype Writing Tasks[G]∥TOEFL Monograph Series.Princeton.NJ:Educational Testing Service.
D9rnyei,Z.2003.Questionnaires in Second Language Research:Construction,Administration,and Processing[M].Mahwah,New Jersey:Lawrence Erlbaum Associates.
Fan,J.2014.Chinese Test Takers’Attitudes towards the Versant English Test:a Mixed-methods Approach[J].Language Testing in Asia(1):6.
Given,L.M.2008.The SAGE Encyclopedia of Qualitative Research Methods(Volume 1&2)[M].London:Sage Publications Ltd.
Hamp-Lyons,L.1986.No New Lamps for Old Yet,Please[J].TESOL Quarterly(4):790-796.
Hamp-Lyons,L.1991.Scoring Procedures[G]∥L.,Hamp-Lyons.Assessing Second Language Writing in Academic Contexts.Norwood,NJ:Ablex:241-276.
Karelitz,T.M.2013.Using Public Opinion to Inform the Validation of Test Scores.Research Report[EB/OL].Http:www.nite.org.il/files/reports/e387.pdf.
Knoch,U.2009.Diagnostic Writing Assessment:The Development and Validation of a Rating Scale[M].Frankfurt,Germany:Peter Lang.
Lee,Y.W.,Gentile,C.&R.Kantor.2008.Analytic Scoring of TOEFL CBT Essays:Scores-from Humans and E-rater[J].ETSResearch Report Series(1):22-31.
McNamara,T.F.1996.Measuring Second Language Performance[M].London and New York Longman.
Messick,S.1989.Validity[G]∥RL Linn.Educational Measurement(3rded.).Macmillan:American Council on Education,13-103.
Shaw,S.D.&Weir,C.J.2007.Examining Writing:Research and Practice in Assessing Second Language Writing[M].Cambridge:Cambridge University Press.
Turner,C.E.2000.Listening to the Voices of Rating Scale Developers:Identifying Salient Features for Second Language Performance Assessment[J].Canadian Modern Language Review(5):555-584.
Weigle,S.2002.Assessing Writing[M].Cambridge:Cambridge University Press.
Weir,C.J.1990.Communicative Language Testing[M].Mahwah:Prentice Hall Regents.
蔡基刚.2002.大学英语四、六级写作要求和评分标准对中国学生写作的影响[J].解放军外国语学院学报(5):49-53.
费茜,赵毓琴.2008.大学英语CET-4写作评分标准中的问题分析[J].外语教学理论与实践(4):45-52,93.
高怀勇.2011.大学英语CET-4写作测试构念效度研究---一项基于试题内部结构和评分过程的尝试[J].外语测试与教学(4):33-41.
辜向东,杨志强.2009.CET二十年写作试题分析与研究[J].外语与外语教学(6):21-26.
黄燕.2007.大学英语四,六级考试网上阅卷情况调查[J].外语界(2):82-88.
简庆闽,陆建平.2005.2004年6月大学英语四级考试写作部分的命题探讨[J].外语与外语教学(1):32-33.
教育部高等教育司.2004.大学英语课程教学要求(试行)[M].北京:高等教育出版社.
金艳.2005.大学英语四、六级考试改革思路与未来展望---解读《全国大学英语四,六级考试改革方案(试行)》[J].中国大学教学(5):49-53.
李航.2015.整体与分项量表的使用对EFL作文评分信度的影响[J].外语与外语教学(2):45-51.
刘建达,黄亚萍.2011.词汇特征量对CET作文得分的影响[J].外语电化教学(3):11-15.
唐锦兰,吴一安.2012.写作自动评价系统在大学英语教学中的应用研究[J].外语与外语教学(4):53-59.
王跃武.2004.大学英语四,六级考试作文网上阅卷实验研究[J].外语界(5):74-79.
王跃武,朱正才,杨惠中.2006.作文网上评分信度的多面Rasch测量分析[J].外语界(1):69-76.
杨惠中,C.Weir.1998.大学英语四、六级考试效度研究[M].上海:上海外语教育出版社.
张森,于朋.2010.大学英语四级考试作文网上评阅信度保障研究[J].外语界(5):79-86.
邹绍艳,高秀雪.2015.大学英语教学中思辨能力培养的现状调查---一项基于反思性问卷的研究[J].外语研究(3):61-65.
Alderson,J.C,C.Clapham&D.Wall.1995.Language Test Construction and Evaluation[M].Cambridge:Cambridge University Press.
Bachman,L.F.&A.S.Palmer.1996.Language Testing in Practice:Designing and Developing Useful Language Tests[M].Oxford University Press.
Barrett,S.2001.The Impact of Training on Rater Variability[J].International Education Journal(1):49-58.
Chapelle,C.A.,Enright,M.K.&J.M.Jamieson.2008.Building a Validity Argument for the Test of English as a Foreign Language[M].New York:Routledge.
Chun,C.2008.Comments on“Evaluationof the Usefulness of the Versant for English Test:a Response”:the Author Responds[J].Language Assessment Quarterly(2):168-172.
Creswell,J.W.&V.L.P.Clark.2011.Designing and Conducting Mixed Methods Research[M].Sage publications.
Cumming,A.,Kantor,R.&D.Powers.2001.An Investigation into Raters’Decision-making,and Development of a Preliminary Analytic Framework for Scoring TOEFL Essays and TOEFL 2000 Prototype Writing Tasks[G]∥TOEFL Monograph Series.Princeton.NJ:Educational Testing Service.
D9rnyei,Z.2003.Questionnaires in Second Language Research:Construction,Administration,and Processing[M].Mahwah,New Jersey:Lawrence Erlbaum Associates.
Fan,J.2014.Chinese Test Takers’Attitudes towards the Versant English Test:a Mixed-methods Approach[J].Language Testing in Asia(1):6.
Given,L.M.2008.The SAGE Encyclopedia of Qualitative Research Methods(Volume 1&2)[M].London:Sage Publications Ltd.
Hamp-Lyons,L.1986.No New Lamps for Old Yet,Please[J].TESOL Quarterly(4):790-796.
Hamp-Lyons,L.1991.Scoring Procedures[G]∥L.,Hamp-Lyons.Assessing Second Language Writing in Academic Contexts.Norwood,NJ:Ablex:241-276.
Karelitz,T.M.2013.Using Public Opinion to Inform the Validation of Test Scores.Research Report[EB/OL].Http:www.nite.org.il/files/reports/e387.pdf.
Knoch,U.2009.Diagnostic Writing Assessment:The Development and Validation of a Rating Scale[M].Frankfurt,Germany:Peter Lang.
Lee,Y.W.,Gentile,C.&R.Kantor.2008.Analytic Scoring of TOEFL CBT Essays:Scores-from Humans and E-rater[J].ETSResearch Report Series(1):22-31.
McNamara,T.F.1996.Measuring Second Language Performance[M].London and New York Longman.
Messick,S.1989.Validity[G]∥RL Linn.Educational Measurement(3rded.).Macmillan:American Council on Education,13-103.
Shaw,S.D.&Weir,C.J.2007.Examining Writing:Research and Practice in Assessing Second Language Writing[M].Cambridge:Cambridge University Press.
Turner,C.E.2000.Listening to the Voices of Rating Scale Developers:Identifying Salient Features for Second Language Performance Assessment[J].Canadian Modern Language Review(5):555-584.
Weigle,S.2002.Assessing Writing[M].Cambridge:Cambridge University Press.
Weir,C.J.1990.Communicative Language Testing[M].Mahwah:Prentice Hall Regents.
蔡基刚.2002.大学英语四、六级写作要求和评分标准对中国学生写作的影响[J].解放军外国语学院学报(5):49-53.
费茜,赵毓琴.2008.大学英语CET-4写作评分标准中的问题分析[J].外语教学理论与实践(4):45-52,93.
高怀勇.2011.大学英语CET-4写作测试构念效度研究---一项基于试题内部结构和评分过程的尝试[J].外语测试与教学(4):33-41.
辜向东,杨志强.2009.CET二十年写作试题分析与研究[J].外语与外语教学(6):21-26.
黄燕.2007.大学英语四,六级考试网上阅卷情况调查[J].外语界(2):82-88.
简庆闽,陆建平.2005.2004年6月大学英语四级考试写作部分的命题探讨[J].外语与外语教学(1):32-33.
教育部高等教育司.2004.大学英语课程教学要求(试行)[M].北京:高等教育出版社.
金艳.2005.大学英语四、六级考试改革思路与未来展望---解读《全国大学英语四,六级考试改革方案(试行)》[J].中国大学教学(5):49-53.
李航.2015.整体与分项量表的使用对EFL作文评分信度的影响[J].外语与外语教学(2):45-51.
刘建达,黄亚萍.2011.词汇特征量对CET作文得分的影响[J].外语电化教学(3):11-15.
唐锦兰,吴一安.2012.写作自动评价系统在大学英语教学中的应用研究[J].外语与外语教学(4):53-59.
王跃武.2004.大学英语四,六级考试作文网上阅卷实验研究[J].外语界(5):74-79.
王跃武,朱正才,杨惠中.2006.作文网上评分信度的多面Rasch测量分析[J].外语界(1):69-76.
杨惠中,C.Weir.1998.大学英语四、六级考试效度研究[M].上海:上海外语教育出版社.
张森,于朋.2010.大学英语四级考试作文网上评阅信度保障研究[J].外语界(5):79-86.
邹绍艳,高秀雪.2015.大学英语教学中思辨能力培养的现状调查---一项基于反思性问卷的研究[J].外语研究(3):61-65.