韩语母语者汉语二语写作质量评估研究——以语言特征和内容质量为测量维度
|
摘要
本文以210名不同汉语水平的韩语母语者为研究对象,采用相关和多重回归的统计方法,首先从总体上考察词汇多样性、词汇复杂性、词汇正确性、汉字正确性、语法正确性、句法复杂性6个语言特征与写作成绩、内容质量评分的关系,然后考察内容质量评分和写作成绩的相关关系,最后考察语言水平对6个语言测量指标和写作成绩关系的影响效应。研究发现,从总体上看,6个语言特征均与写作成绩、内容质量评分显著相关,并且都能显著预测写作成绩,其中汉字正确性、语法正确性和词汇正确性贡献程度最大,且前两者达到中等效应量。除词汇多样性外,其他5个语言特征都能显著预测内容质量评分,其中词汇复杂性贡献程度最大,达到中等效应量。内容质量评分和写作成绩达到高相关。另外,研究还发现语言水平与汉字正确性存在交互效应,与中高级水平相比,初级水平汉字正确性对写作成绩的预测作用更大。与此同时,本文结合学生作文表现、对评分员的访谈以及对测量指标内部构念的分析,对造成语言各维度对写作成绩和内容质量分数不同贡献程度的原因以及写作质量和内容质量的关系进行了相应的质性分析。
This research involves 210 South Korean speakers who are of different Chinese levels.A correlation and a linear regression analysis are conducted to explore the relationship between six language features(lexical diversity,lexical sophistication,lexical accuracy,Chinese character accuracy,grammar accuracy,and syntactic sophistication),writing score and content score.Then the relationship between content score and writing score is explored,which is in turn followed by an analysis of the effect of Chinese level on the relationship between language features and writing score.The results show that all six language features are significantly correlated with writing score and content score and can predict writing score effectively.Of the six features,Chinese character accuracy,grammar accuracy and lexical accuracy contribute the most,with the former two achieving medium effect size.Except lexical diversity,the other five language features can all predict content score,lexical sophistication contributing the most to achieve medium effect size.We also find high correlation between content score and writing score,as well as interaction effect between language level and character accuracy,in that character accuracy best predicts writing score on the basic level.In the mean time,by combining students' writing performance,interview with scorers,and an examination of the internal construct of measure indices,we make a quality analysis of the reasons for the different contributions of language features to writing score and content score,and the relationship between writing quality and content quality.
This research involves 210 South Korean speakers who are of different Chinese levels.A correlation and a linear regression analysis are conducted to explore the relationship between six language features(lexical diversity,lexical sophistication,lexical accuracy,Chinese character accuracy,grammar accuracy,and syntactic sophistication),writing score and content score.Then the relationship between content score and writing score is explored,which is in turn followed by an analysis of the effect of Chinese level on the relationship between language features and writing score.The results show that all six language features are significantly correlated with writing score and content score and can predict writing score effectively.Of the six features,Chinese character accuracy,grammar accuracy and lexical accuracy contribute the most,with the former two achieving medium effect size.Except lexical diversity,the other five language features can all predict content score,lexical sophistication contributing the most to achieve medium effect size.We also find high correlation between content score and writing score,as well as interaction effect between language level and character accuracy,in that character accuracy best predicts writing score on the basic level.In the mean time,by combining students' writing performance,interview with scorers,and an examination of the internal construct of measure indices,we make a quality analysis of the reasons for the different contributions of language features to writing score and content score,and the relationship between writing quality and content quality.
引文
国家汉语水平考试委员会办公室考试中心(2001)《汉语水平词汇与汉字等级大纲》,北京:经济科学出版社。
金檀、刘力、郭凯(2016)口语测试评分标准研究与实践三十年,《现代外语》第6期。
井茁(2013)从中介语发展分析到高级汉语课程设置——内容依托型教学研究的启示,《世界汉语教学》第1期。
秦晓晴、毕劲(2015)《外语教学定量研究方法及数据分析》,北京:外语教学与研究出版社。
施家炜(2002)韩国留学生汉语句式习得的个案研究,《世界汉语教学》第4期。
孙晓明(2009)留学生产出性词汇的发展模式研究,《民族教育研究》第4期。
王佶旻(2002)三类口语考试题型的评分研究,《世界汉语教学》第4期。
王艺璇(2017)汉语二语者词汇丰富性与写作成绩的相关性——兼论测量写作质量的多元线性回归模型及方程,《语言文字应用》第2期。
吴继峰(2016)英语母语者汉语写作中的词汇丰富性发展研究,《世界汉语教学》第1期。
吴继峰(2018a)语言区别性特征对英语母语者汉语二语写作质量评估的影响,《语言教学与研究》第2期。
吴继峰(2018b)韩语母语者汉语书面语句法复杂性测量指标及与写作质量关系研究,《语言科学》第5期。
辛平(2007)基于语言能力构想的作文评分标准及其可操作性研究,《暨南大学华文学院学报》第3期。
朱世芳(2009)韩国汉语第二语言学习者口语语篇发展研究,北京语言大学硕士学位论文。
Banerjee,Jayanti,Xun Yan,Mark Chapman&Heather Elliott(2015)Keeping up with the times:Revising and refreshing a rating scale.Assessing Writing26(4):5-19.
Cohen,Jacob(1988)Statistical power analysis for the behavioral sciences.Hillsdale,NJ:Lawrence Earlbaum Associates.
Crossley,Scott A.&Danielle S.McNamara(2012)Predicting second language writing proficiency:The roles of cohesion and linguistic sophistication.Journal of Research in Reading35(2):115-135.
Crossley,Scott A.,Tom Salsbury&Danielle S.Mcnamara(2015)Assessing lexical proficiency using analytic ratings:A case for collocation accuracy.Applied Linguistics 36(5):570-590.
De Jong,Nivja H.,Margarita P.Steinel,Arjen F.Florijn,Rob Schoonen&Jan H.Hulstijn(2012)Facets of speaking proficiency.Studies in Second Language Acquisition 34(1):5-34.
Humphry,Stephen Mark&Sandra Allison Heldsinger(2014)Common structural design features of rubrics may represent a threat to validity.Educational Researcher 43(5):253-263.
Jarvis,Scott(2002)Short texts,best-fitting curves and new measures of lexical diversity.Language Testing19(1):57-84.
Jiang,Wenying(2013)Measurements of development in L2written production:The case of L2Chinese.Applied Linguistic 34:1-24.
Jin,Tan&Barley Mak(2013)Distinguishing features in scoring L2Chinese speaking performance:How do they work?Language Testing30(1):23-47.
Kuiken,Folkert&Ineke Vedder(2014)Rating written performance:What do raters do and why?Language Testing31(3):329-348.
Kuiken,Folkert&Ineke Vedder(2017)Functional adequacy in L2writing:Towards a new rating scale.Language Testing34(3):321-336.
Kuiken,Folkert,Ineke Vedder&Roger Gilabert(2010)Communicative adequacy and linguistic complexity in L2writing.In Inge Bartning,Maisa Martin and Ineke Vedder(eds.),Communicative proficiency and linguistic development:Intersections between SLA and language testing research,81-100.Eurosla Monographs Series 1.European Second Language Association.
Martin,William E.&Krista D.Bridgmon(2012)Quantitative and statistical research methods:From hypothesis to results.San Francisco:Jossey-Bass.
Pallotti,Gabriele(2009)CAF:Defining,refining and differentiating constructs.Applied Linguistics 30(4):590-601.
Plakans,Lia,Atta Gebril&Zeynep Bilki(2016)Shaping a score:Complexity,accuracy,and fluency in integrated writing performances.Language Testing,https://doi.org/10.1177/0265532216669537.(Pre-published 26Sep 2016)
Plonsky,Luke&Hessameddin Ghanbar(2018)Multiple regression in L2research:A methodological synthesis and guide to interpreting R2 values.The Modern Language Journal 102(4):713-731.
Read,John(2000)Assessing vocabulary.Cambridge:Cambridge University Press.
Révész,Andrea,Monika Ekiert&Eivind Nessa Torgersen(2016)The effects of complexity,accuracy,and fluency on communicative adequacy in oral task performance.Applied Linguistics 37(6):828-848.
Tabachnick,Barbara G.&Linda S.Fidell(2013)Using multivariate statistics,6th edn.Boston:Pearson Education.
金檀、刘力、郭凯(2016)口语测试评分标准研究与实践三十年,《现代外语》第6期。
井茁(2013)从中介语发展分析到高级汉语课程设置——内容依托型教学研究的启示,《世界汉语教学》第1期。
秦晓晴、毕劲(2015)《外语教学定量研究方法及数据分析》,北京:外语教学与研究出版社。
施家炜(2002)韩国留学生汉语句式习得的个案研究,《世界汉语教学》第4期。
孙晓明(2009)留学生产出性词汇的发展模式研究,《民族教育研究》第4期。
王佶旻(2002)三类口语考试题型的评分研究,《世界汉语教学》第4期。
王艺璇(2017)汉语二语者词汇丰富性与写作成绩的相关性——兼论测量写作质量的多元线性回归模型及方程,《语言文字应用》第2期。
吴继峰(2016)英语母语者汉语写作中的词汇丰富性发展研究,《世界汉语教学》第1期。
吴继峰(2018a)语言区别性特征对英语母语者汉语二语写作质量评估的影响,《语言教学与研究》第2期。
吴继峰(2018b)韩语母语者汉语书面语句法复杂性测量指标及与写作质量关系研究,《语言科学》第5期。
辛平(2007)基于语言能力构想的作文评分标准及其可操作性研究,《暨南大学华文学院学报》第3期。
朱世芳(2009)韩国汉语第二语言学习者口语语篇发展研究,北京语言大学硕士学位论文。
Banerjee,Jayanti,Xun Yan,Mark Chapman&Heather Elliott(2015)Keeping up with the times:Revising and refreshing a rating scale.Assessing Writing26(4):5-19.
Cohen,Jacob(1988)Statistical power analysis for the behavioral sciences.Hillsdale,NJ:Lawrence Earlbaum Associates.
Crossley,Scott A.&Danielle S.McNamara(2012)Predicting second language writing proficiency:The roles of cohesion and linguistic sophistication.Journal of Research in Reading35(2):115-135.
Crossley,Scott A.,Tom Salsbury&Danielle S.Mcnamara(2015)Assessing lexical proficiency using analytic ratings:A case for collocation accuracy.Applied Linguistics 36(5):570-590.
De Jong,Nivja H.,Margarita P.Steinel,Arjen F.Florijn,Rob Schoonen&Jan H.Hulstijn(2012)Facets of speaking proficiency.Studies in Second Language Acquisition 34(1):5-34.
Humphry,Stephen Mark&Sandra Allison Heldsinger(2014)Common structural design features of rubrics may represent a threat to validity.Educational Researcher 43(5):253-263.
Jarvis,Scott(2002)Short texts,best-fitting curves and new measures of lexical diversity.Language Testing19(1):57-84.
Jiang,Wenying(2013)Measurements of development in L2written production:The case of L2Chinese.Applied Linguistic 34:1-24.
Jin,Tan&Barley Mak(2013)Distinguishing features in scoring L2Chinese speaking performance:How do they work?Language Testing30(1):23-47.
Kuiken,Folkert&Ineke Vedder(2014)Rating written performance:What do raters do and why?Language Testing31(3):329-348.
Kuiken,Folkert&Ineke Vedder(2017)Functional adequacy in L2writing:Towards a new rating scale.Language Testing34(3):321-336.
Kuiken,Folkert,Ineke Vedder&Roger Gilabert(2010)Communicative adequacy and linguistic complexity in L2writing.In Inge Bartning,Maisa Martin and Ineke Vedder(eds.),Communicative proficiency and linguistic development:Intersections between SLA and language testing research,81-100.Eurosla Monographs Series 1.European Second Language Association.
Martin,William E.&Krista D.Bridgmon(2012)Quantitative and statistical research methods:From hypothesis to results.San Francisco:Jossey-Bass.
Pallotti,Gabriele(2009)CAF:Defining,refining and differentiating constructs.Applied Linguistics 30(4):590-601.
Plakans,Lia,Atta Gebril&Zeynep Bilki(2016)Shaping a score:Complexity,accuracy,and fluency in integrated writing performances.Language Testing,https://doi.org/10.1177/0265532216669537.(Pre-published 26Sep 2016)
Plonsky,Luke&Hessameddin Ghanbar(2018)Multiple regression in L2research:A methodological synthesis and guide to interpreting R2 values.The Modern Language Journal 102(4):713-731.
Read,John(2000)Assessing vocabulary.Cambridge:Cambridge University Press.
Révész,Andrea,Monika Ekiert&Eivind Nessa Torgersen(2016)The effects of complexity,accuracy,and fluency on communicative adequacy in oral task performance.Applied Linguistics 37(6):828-848.
Tabachnick,Barbara G.&Linda S.Fidell(2013)Using multivariate statistics,6th edn.Boston:Pearson Education.