基于安戈夫法的青少年问题性移动社交网络使用评估标准
|
摘要
使用安戈夫法界定青少年问题性移动社交网络使用评估标准。结果发现,筛查评估问卷中8个及以上题目持肯定回答即可评估为问题性移动社交网络使用,实证区分效度中正常使用者检出率为12%,问题性使用者检出率为91.1%。基于安戈夫法的青少年问题性移动社交网络使用评估工具有较好的心理学测量属性,可用于青少年问题性移动社交网络使用的筛查评估。
With the increase of the number of problematic mobile social network usage, the subsequent psychological problems are emerging. The traditional norm referencing test can no longer meet the needs of screening and evaluating of this problem. The existing evaluation tool mainly has the following problems: first, most of the tools continue the research idea of internet addiction, which is based on the symptom criteria of pathological gambling, and leads to a lot of similarities in the structure of the tools; Second, the current preparation of such tools is mainly based on the use of Facebook, according to the features of Facebook to set the appropriate topic; Third, the problematic mobile social network usage related scales have no specific distinction between the online social network based on the traditional Internet or the online social network based on the mobile terminal; Fourth, existing mobile phone or social network related evaluation tools can only explore the basic structure or severity of the phenomenon, but does not have the function of screening; Fifth, this kind of tool is mainly based on foreign research, and there is no special screening assessment tool for mobile social network in our country.In order to further screen and evaluate the problematic mobile social network usage, based on the relevant symptoms and theoretical structures of the Handbook on Mental Illness Statistics and Diagnosis(DSM-5) and the realistic social representation of the problematic mobile social network usage, this paper uses Angoff method to define and evaluate the problematic mobile social network usage for adolescents. The classic Angoff method requires the selection of highly experienced experts to form a panel that assesses the probability of affirmative answers to a test question for a typical person who has just reached a certain minimum level of competence, and the score on the entire scale averaging to obtain a critical value. If the test scores greater than the critical value, it is considered to reach a certain level. The study improves Angoff method, providing a priori probability to choose for the experts in the expert evaluation, and two evaluation exercises in the official evaluation. Therefore, all experts are skilled operator, which can reduce the error caused by the expert is not skilled enough.According to the standardized process compiled by the questionnaire, this study collected data from university teachers, middle school teachers, psychological counsellors, middle school students and college students. The evaluation samples of Angoff method include teacher expert sample, adolescent expert sample, reliability and validity test sample. The expert sample is composed of 15 teachers and 15 teenagers. The reliability test samples are 768 adolescents, 90 problem users and normal users. The results show that: there are eight or more questions with positive answers that can be assessed as problematic mobile social network usage in the screening assessment questionnaire. In the empirical discriminant validity test, the detection rate of normal users is 12%, and the detection rate of problematic users is 91.1%. Based on the Angoff method, the evaluation tool for the problematic mobile social network usage has a good psychological measurement attribute, which can be used for the evaluation of the problematic mobile social network usage.
With the increase of the number of problematic mobile social network usage, the subsequent psychological problems are emerging. The traditional norm referencing test can no longer meet the needs of screening and evaluating of this problem. The existing evaluation tool mainly has the following problems: first, most of the tools continue the research idea of internet addiction, which is based on the symptom criteria of pathological gambling, and leads to a lot of similarities in the structure of the tools; Second, the current preparation of such tools is mainly based on the use of Facebook, according to the features of Facebook to set the appropriate topic; Third, the problematic mobile social network usage related scales have no specific distinction between the online social network based on the traditional Internet or the online social network based on the mobile terminal; Fourth, existing mobile phone or social network related evaluation tools can only explore the basic structure or severity of the phenomenon, but does not have the function of screening; Fifth, this kind of tool is mainly based on foreign research, and there is no special screening assessment tool for mobile social network in our country.In order to further screen and evaluate the problematic mobile social network usage, based on the relevant symptoms and theoretical structures of the Handbook on Mental Illness Statistics and Diagnosis(DSM-5) and the realistic social representation of the problematic mobile social network usage, this paper uses Angoff method to define and evaluate the problematic mobile social network usage for adolescents. The classic Angoff method requires the selection of highly experienced experts to form a panel that assesses the probability of affirmative answers to a test question for a typical person who has just reached a certain minimum level of competence, and the score on the entire scale averaging to obtain a critical value. If the test scores greater than the critical value, it is considered to reach a certain level. The study improves Angoff method, providing a priori probability to choose for the experts in the expert evaluation, and two evaluation exercises in the official evaluation. Therefore, all experts are skilled operator, which can reduce the error caused by the expert is not skilled enough.According to the standardized process compiled by the questionnaire, this study collected data from university teachers, middle school teachers, psychological counsellors, middle school students and college students. The evaluation samples of Angoff method include teacher expert sample, adolescent expert sample, reliability and validity test sample. The expert sample is composed of 15 teachers and 15 teenagers. The reliability test samples are 768 adolescents, 90 problem users and normal users. The results show that: there are eight or more questions with positive answers that can be assessed as problematic mobile social network usage in the screening assessment questionnaire. In the empirical discriminant validity test, the detection rate of normal users is 12%, and the detection rate of problematic users is 91.1%. Based on the Angoff method, the evaluation tool for the problematic mobile social network usage has a good psychological measurement attribute, which can be used for the evaluation of the problematic mobile social network usage.
引文
常蕤.(2008).一种基于Rasch模型的Angoff方法及其应用.心理学探新,28(4),76-79.
崔丽娟.(2006).用安戈夫方法对网络成瘾与网络游戏成瘾的界定.应用心理学,12(2),142-147.
崔丽娟,赵鑫.(2004).用安戈夫(Angoff)方法对网络成瘾的标准设定.心理科学,27(3),721-723.
花蓉,武晓锐,方芳.(2016).手机成瘾大学生注意偏向的实验研究.心理学探新,36(5),446-450.
黄华炎,刘毅,路红,彭坚.(2016).网络社交用户主观幸福感:概念、测量、影响因素.广州大学学报(社会科学版),15(3),62-68,96.
姜永志.(2018).青少年问题性移动社交网络使用研究.内蒙古师范大学博士学位论文.
余嘉元.(2008).Angoff方法有效性的检验研究.教育研究与实验,1,54-57.
周宗奎,连帅磊,田媛,牛更枫,孙晓军.(2017).社交网站使用与青少年生活满意度的关系:一个有调节的中介模型.心理发展与教育,33(3),297-305.
Al-Menayes,J.(2015).Psychometric properties and validation of the Arabic social media addiction scale.Journal of Addiction,2015,291743.
Billieux,J.,Maurage,P.,Lopez-Fernandez,O.,Kuss,D.J.,&Griffiths,M.D.(2015).Can disordered mobile phone use be considered a behavioral addiction?An update on current evidence and a comprehensive model for future research.Current Addiction Reports,2(2),156-162.
Billieux,J.,van der Linden,M.,&Rochat,L.(2008).The role of impulsivity in actual and problematic use of the mobile phone.Applied Cognitive Psychology,22(9),1195-1210.
B?achnio,A.,Przepiorka,A.,Boruch,W.,&Ba?akier,E.(2016).Self-presentation styles,privacy,and loneliness as predictors of Facebook use in young people.Personality and Individual Differences,94,26-31.
Hejri,S.M.,Jalili,M.,&Labaf,A.(2012).Setting standard threshold scores for an objective structured clinical examination using Angoff method and assessing the impact of reality chacking and discussion on actual scores.Iranian Journal of Medical Education,11(8),885-894.
Hurtz,G.M.,Auerbach,M.A.,&Hurtz,G.M.(2003).A meta-analysis of the effects of modifications to the Angoff method on cutoff scores and judgment consensus.Educational and Psychological Measurement,63(4),584-601.
Jaeger,R.M.(1978).About educational indicators:Statistics on the conditions and trends in education.Review of Research in Education,6(1),276-315.
Jalili,M.,Hejri,S.M.,&Norcini,J.J.(2011).Comparison of two methods of standard setting:The performance of the three-level Angoff method.Medical Education,45(12),1199-1208.
Kamath,M.G.,Pallath,V.,Ramnarayan,K.,Kamath,A.,Torke,S.,&Gonsalves,J.(2016).Standard setting of objective structured practical examination by modified Angoff method:A pilot study.National Medical Journal of India,29(3),160-162.
Kane,M.T.(1987).On the use of IRT models with judgmental standard setting procedures.Journal of Educational Measurement,24(4),333-345.
Korpinen,L.,P??kk?nen,R.,&Gobba,F.(2015).Self-reported ache,pain,or numbness in hip and lower back and use of computers and cell phones amongst Finns aged 18-65.International Journal of Industrial Ergonomics,48,70-76.
Kuss,D.J.,&Griffiths,M.D.(2011).Online social networking and addiction-Areview of the psychological literature.International Journal of Environmental Research and Public Health,8(9),3528-3552.
Lapointe,L.,Boudreau-Pinsonneault,C.,&Vaghefi,I.(2013).Is smartphone usage truly smart?A qualitative investigation of IT addictive behaviors.In Proceedings of the 2013 46th Hawaii International Conference on System Sciences(pp.1063-1072).Wailea,Maui,HI:IEEE.
Lee,W.J.(2013).An exploratory study on addictive use of smartphone:Developing SAUS(Smartphone Addictive Use Scale).Journal of Convergence Information Technology,8(12),403-407.
Pamuk,M.,&Atli,A.(2016).üniversite??rencileri i?in Problemli Cep Telefonu Kullan?m?l?e?i’nin geli?tirilmesi:Ge?erlik ve güvenirlik?al??mas?.Dusunen Adam:The Journal of Psychiatry and Neurological Sciences,29(1),49-59.
Taube,K.T.(1997).The incorporation of empirical item difficulty data into the Angoff standard-setting procedure.Evaluation and the Health Professions,20(4),479-498
Toda,M.,Monden,K.,Kubo,K.,&Morimoto,K.(2004).Cellular phone dependence tendency of female university students.Nihon Eiseigaku Zasshi.Japanese Journal of Hygiene,59(4),383-386.
Wang,J.L.,Wang,H.Z.,Gaskin,J.,&Wang,L.H.(2015).The role of stress and motivation in problematic smartphone use among college students.Computers in Human Behavior,53,181-188.
Yudkowsky,R.,Downing,S.M.,&Popescu,M.(2008).Setting standards for performance tests:A pilot study of a three-level Angoff method.Academic Medicine,83(10),S13-S16.
崔丽娟.(2006).用安戈夫方法对网络成瘾与网络游戏成瘾的界定.应用心理学,12(2),142-147.
崔丽娟,赵鑫.(2004).用安戈夫(Angoff)方法对网络成瘾的标准设定.心理科学,27(3),721-723.
花蓉,武晓锐,方芳.(2016).手机成瘾大学生注意偏向的实验研究.心理学探新,36(5),446-450.
黄华炎,刘毅,路红,彭坚.(2016).网络社交用户主观幸福感:概念、测量、影响因素.广州大学学报(社会科学版),15(3),62-68,96.
姜永志.(2018).青少年问题性移动社交网络使用研究.内蒙古师范大学博士学位论文.
余嘉元.(2008).Angoff方法有效性的检验研究.教育研究与实验,1,54-57.
周宗奎,连帅磊,田媛,牛更枫,孙晓军.(2017).社交网站使用与青少年生活满意度的关系:一个有调节的中介模型.心理发展与教育,33(3),297-305.
Al-Menayes,J.(2015).Psychometric properties and validation of the Arabic social media addiction scale.Journal of Addiction,2015,291743.
Billieux,J.,Maurage,P.,Lopez-Fernandez,O.,Kuss,D.J.,&Griffiths,M.D.(2015).Can disordered mobile phone use be considered a behavioral addiction?An update on current evidence and a comprehensive model for future research.Current Addiction Reports,2(2),156-162.
Billieux,J.,van der Linden,M.,&Rochat,L.(2008).The role of impulsivity in actual and problematic use of the mobile phone.Applied Cognitive Psychology,22(9),1195-1210.
B?achnio,A.,Przepiorka,A.,Boruch,W.,&Ba?akier,E.(2016).Self-presentation styles,privacy,and loneliness as predictors of Facebook use in young people.Personality and Individual Differences,94,26-31.
Hejri,S.M.,Jalili,M.,&Labaf,A.(2012).Setting standard threshold scores for an objective structured clinical examination using Angoff method and assessing the impact of reality chacking and discussion on actual scores.Iranian Journal of Medical Education,11(8),885-894.
Hurtz,G.M.,Auerbach,M.A.,&Hurtz,G.M.(2003).A meta-analysis of the effects of modifications to the Angoff method on cutoff scores and judgment consensus.Educational and Psychological Measurement,63(4),584-601.
Jaeger,R.M.(1978).About educational indicators:Statistics on the conditions and trends in education.Review of Research in Education,6(1),276-315.
Jalili,M.,Hejri,S.M.,&Norcini,J.J.(2011).Comparison of two methods of standard setting:The performance of the three-level Angoff method.Medical Education,45(12),1199-1208.
Kamath,M.G.,Pallath,V.,Ramnarayan,K.,Kamath,A.,Torke,S.,&Gonsalves,J.(2016).Standard setting of objective structured practical examination by modified Angoff method:A pilot study.National Medical Journal of India,29(3),160-162.
Kane,M.T.(1987).On the use of IRT models with judgmental standard setting procedures.Journal of Educational Measurement,24(4),333-345.
Korpinen,L.,P??kk?nen,R.,&Gobba,F.(2015).Self-reported ache,pain,or numbness in hip and lower back and use of computers and cell phones amongst Finns aged 18-65.International Journal of Industrial Ergonomics,48,70-76.
Kuss,D.J.,&Griffiths,M.D.(2011).Online social networking and addiction-Areview of the psychological literature.International Journal of Environmental Research and Public Health,8(9),3528-3552.
Lapointe,L.,Boudreau-Pinsonneault,C.,&Vaghefi,I.(2013).Is smartphone usage truly smart?A qualitative investigation of IT addictive behaviors.In Proceedings of the 2013 46th Hawaii International Conference on System Sciences(pp.1063-1072).Wailea,Maui,HI:IEEE.
Lee,W.J.(2013).An exploratory study on addictive use of smartphone:Developing SAUS(Smartphone Addictive Use Scale).Journal of Convergence Information Technology,8(12),403-407.
Pamuk,M.,&Atli,A.(2016).üniversite??rencileri i?in Problemli Cep Telefonu Kullan?m?l?e?i’nin geli?tirilmesi:Ge?erlik ve güvenirlik?al??mas?.Dusunen Adam:The Journal of Psychiatry and Neurological Sciences,29(1),49-59.
Taube,K.T.(1997).The incorporation of empirical item difficulty data into the Angoff standard-setting procedure.Evaluation and the Health Professions,20(4),479-498
Toda,M.,Monden,K.,Kubo,K.,&Morimoto,K.(2004).Cellular phone dependence tendency of female university students.Nihon Eiseigaku Zasshi.Japanese Journal of Hygiene,59(4),383-386.
Wang,J.L.,Wang,H.Z.,Gaskin,J.,&Wang,L.H.(2015).The role of stress and motivation in problematic smartphone use among college students.Computers in Human Behavior,53,181-188.
Yudkowsky,R.,Downing,S.M.,&Popescu,M.(2008).Setting standards for performance tests:A pilot study of a three-level Angoff method.Academic Medicine,83(10),S13-S16.