HSK[初级]口语考试能力维度研究
|
摘要
本研究旨在运用多维多值潜在特质模型(MPLT模型)考查改进版HSK[初级]口语考试的潜在能力维度。首先使用联合极大似然估计法估计出模型的难度参数和被试能力值,并对这些值进行描述性统计分析和正态分布检验。最后采用残差分析和卡方检验两种方法对模型的拟合度进行检验。研究结果表明,模型在单个题目上和整体上都拟合良好,能够证实我们的研究假设,即改进版HSK[初级]口语考试测出了两种能力:听力理解力和口语能力。
This thesis aims at analyzing the latent traits of HSK[Elementary] Spoken Test. Research data is drawn from the HSK[Elementary] Spoken Test held in November 2007. We choose the first two parts of the spoken test, 40 items in all, and 78 examinees. Our research hypothesis that there are two latent traits behind the spoken test. In order to verify this, we apply the Multidimensional Polytomous Latent Trait model, which was raised by Kelderman and Rijkes in 1994 to estimate the item-parameters and the two abilities. The Joint Maximum Likelihood Estimation method is applied to estimate the item parameters and the value of abilities. The fit-of-goodness is checked in two different ways: residuals and chi-square test. Results show that the model fits the data well and our hypothesis is basically supported.
This thesis aims at analyzing the latent traits of HSK[Elementary] Spoken Test. Research data is drawn from the HSK[Elementary] Spoken Test held in November 2007. We choose the first two parts of the spoken test, 40 items in all, and 78 examinees. Our research hypothesis that there are two latent traits behind the spoken test. In order to verify this, we apply the Multidimensional Polytomous Latent Trait model, which was raised by Kelderman and Rijkes in 1994 to estimate the item-parameters and the two abilities. The Joint Maximum Likelihood Estimation method is applied to estimate the item parameters and the value of abilities. The fit-of-goodness is checked in two different ways: residuals and chi-square test. Results show that the model fits the data well and our hypothesis is basically supported.
引文
A.Anastasi,1982,Psychological Testing.New York:Macmillan Publishing Co.,Inc.
AEPA,APA&NCME.1999.Standards for Educational and Psychological Testing.Washington,DC:AERA.
Bachman,L.F.1990.Fundamental Considerations in Language Testing.Oxford University Press.
Bachman,L.F.& Cohen,A.D.(1998) Interface Between Second Language Acquisition and Language Testing Research,Cambridge University Press
Baker,F.B.& Kim,SH.2004.Item Response Theory:Parameter Estimation Techniques(second edition).Marcel Dekker,Inc.
Bolt,D.M.& Lall,V.F.2003.Estimation of Compensatory and Noncompensatory Multidimensional Item Response Models Using Markov Chain Monte Carlo.Applied Psychological Measurement,Vol.27 No.6,November 2003
Carroll,J.(1961) Fundamental Consideration in Testing for English Langage Proficiency of Foreign Students,Allen & Campbell(eds.):Teaching English as a Second Language,McGraw-Hill Book Company
Embretson,S.E.& Reise,S.P.2000.Item Response Theory for Psychologists.Lawrence Erlbaum Associates,Publishers,Mahwah,New Jersey.
Hambleton,R.K.& Swaminathan,H.1985.Item Response Theory:Principles and Applications.Kluwer Nijhoff Publishing
Hambleton,R.K.,Swaminathan,H.& Rogers,H.J.1991.Fundamentals of Item Response Theory.Thousand Oaks:Sage Publications
Henning,G.1987.A Guide to Language Testing:Development,Evaluation and Research,外语教学与研究出版社,2001.9
Kelderman,H.1988,Loglinear Multidimensional IRT Models for Polytomously Items,Project Psychometric Aspects of Item Banking,No,41,U.S.Department of Education.
Kelderman,H.1994,Loglinear multidimensional IRT models for polytomously scored items,Psychometrika Psychometrika,v59 n2 p149-76 Jun 1994,New York:Springer.
Kelderman,H.1997,Loglinear multidimensional IRT models for polytomously scored items,Handbook of Modern Item Response Theory(pp.289-304),New York:Springer.
Kelderman,H.(2007) Understanding and estimating Multivariate Mixed Rasch Models as Loglinear models,M.von Davier & C.H.Carstensen(Eds.),Multivariate and Mixture Distribution Rasch Models.(pp.77-99).statistics for Social and Behavioral Sciences.New York:Springer.
Lado,R.(1961) Language Testing:the construction and use of foreign language tests,Longman.
L.Crocker ＆ J.Algina Introduction to Classical and Modern Test Theory,金瑜译,2004,华东师范大学出版社
Lord,F.M.& Novick,M.R.1968.Statistical theories of mental test scores.Reading Mass:Addison-Wesley
Lord,F.M.& Novick,M.R.1968.Statistical Theories of Mental Test Scores.Reading Mass:Addison-wesley.
Messick,S.1989.Validity.Educational Measurement(third edition),1993,American Council on Education,ORYX Press.
Messick,S.1995.Validity of Psychological Assessment.American Psychologist Molenaar,I.W.2001.Thirty years of nonparametric item response theory.Applied Psychological Measurement,25(3):295-299.
Nitko,A.j.1983,educational tests and mearurement.Harcourt Brace Jovanovich,Inc.Reckase,M.D.1985.The difficulty of items that measure more than one latent ability.Applied Psychological Measurement
R.Ostini & M.L.Nering,2006,Polytomous Item Response Theory,SAGE Publications
Reckase,M.D.1997.A Linear Logistic Multidimensional Model for Dichotomous Item Response Data.In W.J.van der Linden & R.K.Hambleton(Eds.),Handbook of Modern Item Response Theory.New York:Springer-Verlag.
陈宏,2002,HSK(初中等)在变量关系控制方面的尝试,汉语水平考试研究文集,经济科学出版社
郭树军.1995.汉语水平考试(HSK)项目内部结构效度检验.汉语水平考试研究论文选,现代出版社
贾俊平、何晓群、金勇进,2007,统计学(第三版),中国人民大学出版社
钱亮亮,1996,HSK初中等能力维度分析
盛骤、谢式千、潘乘毅,2001,概率论与数理统计,高等教育出版社
同济大学应用数学系,2001,高等数学(第五版)
张凯.,1992,汉语水平考试结构效度初探,首届汉语考试国际学术讨论会论文选1994,北京语言学院出版社
张凯,2002,语言测验理论与实践,北京语言大学出版社
张凯,2004,测量是理论的组成部分--再谈构想效度,云南师范大学学报,外汉语教学与研究版,2004,云南师范大学出版社
张厚粲、徐建平.2003.现代心理与教育统计学.北京师范大学
张军,2007,HSK潜在维度的探索性分析,硕士学位论文
中国汉语水平考试HSK[改进版]样卷:116-118,2007北京语言大学汉语水平考试
AEPA,APA&NCME.1999.Standards for Educational and Psychological Testing.Washington,DC:AERA.
Bachman,L.F.1990.Fundamental Considerations in Language Testing.Oxford University Press.
Bachman,L.F.& Cohen,A.D.(1998) Interface Between Second Language Acquisition and Language Testing Research,Cambridge University Press
Baker,F.B.& Kim,SH.2004.Item Response Theory:Parameter Estimation Techniques(second edition).Marcel Dekker,Inc.
Bolt,D.M.& Lall,V.F.2003.Estimation of Compensatory and Noncompensatory Multidimensional Item Response Models Using Markov Chain Monte Carlo.Applied Psychological Measurement,Vol.27 No.6,November 2003
Carroll,J.(1961) Fundamental Consideration in Testing for English Langage Proficiency of Foreign Students,Allen & Campbell(eds.):Teaching English as a Second Language,McGraw-Hill Book Company
Embretson,S.E.& Reise,S.P.2000.Item Response Theory for Psychologists.Lawrence Erlbaum Associates,Publishers,Mahwah,New Jersey.
Hambleton,R.K.& Swaminathan,H.1985.Item Response Theory:Principles and Applications.Kluwer Nijhoff Publishing
Hambleton,R.K.,Swaminathan,H.& Rogers,H.J.1991.Fundamentals of Item Response Theory.Thousand Oaks:Sage Publications
Henning,G.1987.A Guide to Language Testing:Development,Evaluation and Research,外语教学与研究出版社,2001.9
Kelderman,H.1988,Loglinear Multidimensional IRT Models for Polytomously Items,Project Psychometric Aspects of Item Banking,No,41,U.S.Department of Education.
Kelderman,H.1994,Loglinear multidimensional IRT models for polytomously scored items,Psychometrika Psychometrika,v59 n2 p149-76 Jun 1994,New York:Springer.
Kelderman,H.1997,Loglinear multidimensional IRT models for polytomously scored items,Handbook of Modern Item Response Theory(pp.289-304),New York:Springer.
Kelderman,H.(2007) Understanding and estimating Multivariate Mixed Rasch Models as Loglinear models,M.von Davier & C.H.Carstensen(Eds.),Multivariate and Mixture Distribution Rasch Models.(pp.77-99).statistics for Social and Behavioral Sciences.New York:Springer.
Lado,R.(1961) Language Testing:the construction and use of foreign language tests,Longman.
L.Crocker ＆ J.Algina Introduction to Classical and Modern Test Theory,金瑜译,2004,华东师范大学出版社
Lord,F.M.& Novick,M.R.1968.Statistical theories of mental test scores.Reading Mass:Addison-Wesley
Lord,F.M.& Novick,M.R.1968.Statistical Theories of Mental Test Scores.Reading Mass:Addison-wesley.
Messick,S.1989.Validity.Educational Measurement(third edition),1993,American Council on Education,ORYX Press.
Messick,S.1995.Validity of Psychological Assessment.American Psychologist Molenaar,I.W.2001.Thirty years of nonparametric item response theory.Applied Psychological Measurement,25(3):295-299.
Nitko,A.j.1983,educational tests and mearurement.Harcourt Brace Jovanovich,Inc.Reckase,M.D.1985.The difficulty of items that measure more than one latent ability.Applied Psychological Measurement
R.Ostini & M.L.Nering,2006,Polytomous Item Response Theory,SAGE Publications
Reckase,M.D.1997.A Linear Logistic Multidimensional Model for Dichotomous Item Response Data.In W.J.van der Linden & R.K.Hambleton(Eds.),Handbook of Modern Item Response Theory.New York:Springer-Verlag.
陈宏,2002,HSK(初中等)在变量关系控制方面的尝试,汉语水平考试研究文集,经济科学出版社
郭树军.1995.汉语水平考试(HSK)项目内部结构效度检验.汉语水平考试研究论文选,现代出版社
贾俊平、何晓群、金勇进,2007,统计学(第三版),中国人民大学出版社
钱亮亮,1996,HSK初中等能力维度分析
盛骤、谢式千、潘乘毅,2001,概率论与数理统计,高等教育出版社
同济大学应用数学系,2001,高等数学(第五版)
张凯.,1992,汉语水平考试结构效度初探,首届汉语考试国际学术讨论会论文选1994,北京语言学院出版社
张凯,2002,语言测验理论与实践,北京语言大学出版社
张凯,2004,测量是理论的组成部分--再谈构想效度,云南师范大学学报,外汉语教学与研究版,2004,云南师范大学出版社
张厚粲、徐建平.2003.现代心理与教育统计学.北京师范大学
张军,2007,HSK潜在维度的探索性分析,硕士学位论文
中国汉语水平考试HSK[改进版]样卷:116-118,2007北京语言大学汉语水平考试