基于学习分析技术的问题解决能力测评研究
|
摘要
随着数字革命向数据革命的迈进,信息技术的优越性被发挥到极致。除了富媒体结合物联网带来的"智能化"特征外,技术支持的过程观察有助于进一步观测那些会随机变化的细微行为,并产生以时间为标记的行为足迹。结合新的计算方法和挖掘技术分析那些海量且相互关联的数据,研究者能获得更具洞察力和决策力的信息。在此背景下,本文在融合内隐认知、信息加工及思维特征的基础上,构建了反映问题解决心理过程的能力评价模型,并根据问题解决心理与行为的映射原理设计了测量工具,依托技术支持的过程观察实现了对问题解决能力的多维评价。本文以实证研究验证了模型的有效性并发现:上海小学生问题解决能力大多处于元认知增强期与认知结构整合期,部分学生达到了认知结构淬炼期,少部分学生仍停留在概念发展期。本文期望这种创新的问题解决能力评价方法在评价学习者能力的基础上,能对其他高阶思维能力的测评提供借鉴。
As the digital revolution advanced to the data revolution, the superiority of information technology was also brought into full play. Besides the intelligence brought by the Internet of things and rich media, technically supported process observation means that we can observe subtle behaviors. Combined with the new calculating methods and techniques to mine and interpret these vast and inter-connected data, the researchers can gain more insight and decision-making analysis. In this context, on the basis of integrating implicit cognition, information processing and thinking features, this paper constructed the ability evaluation model to reflect the psychological image of problem-solving process, and developed a measuring tool to have the multidimensional evaluation of problem-solving ability. The validity of the model was verified by empirical study, and some effective conclusions was discussed.
As the digital revolution advanced to the data revolution, the superiority of information technology was also brought into full play. Besides the intelligence brought by the Internet of things and rich media, technically supported process observation means that we can observe subtle behaviors. Combined with the new calculating methods and techniques to mine and interpret these vast and inter-connected data, the researchers can gain more insight and decision-making analysis. In this context, on the basis of integrating implicit cognition, information processing and thinking features, this paper constructed the ability evaluation model to reflect the psychological image of problem-solving process, and developed a measuring tool to have the multidimensional evaluation of problem-solving ability. The validity of the model was verified by empirical study, and some effective conclusions was discussed.
引文
[1] Ali, L., Asadi, M., Gasevic, D., Jovanovic, J., & Hatala, M.(2013). Factors influencing beliefs for adoption of a learning analytics tool: An empirical study[J]. Computers & Education, 62:130-148.
[2] Artz, A. F., & Armour-Thomas, E.(1992). Development of a cognitive-metacognitive framework for protocol analysis of mathematical problem solving in small groups[J]. Cognition and instruction, 9(2): 137-175.
[3] Bozoki, A., Radovanovic, M., Winn, B., Heeter, C., & Anthony, J. C.(2013). Effects of a computer-based cognitive exercise program on age-related cognitive decline[J]. Archives of Gerontology and Geriatrics, 57(1): 1-7.
[4] Chandrasekaran, B. (1990). Design problem solving: A task analysis[J]. AI magazine, 11(4): 59.
[5] 陈雪枫, 张厚粲(1998). 认知速度在智力结构中重要性的发展研究[J]. 心理科学, 21(6): 485-574.
[6] Culbertson, W. C., & Zillmer, E. A.(1998). The construct validity of the Tower of London DX as a measure of the executive functioning of ADHD children[J]. Assessment, 5(3): 215-226.
[7] D’Zurilla, T. J., & Goldfried, M. R.(1971). Problem solving and behavior modification[J]. Journal of abnormal psychology, 78(1): 107.
[8] EUROPEA(2006). Key Competences for Lifelong Learning-A European Reference [EB/OL]. [2006-12-30]. https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=3&cad=rja&uact=8&ved=0ahUKEwiimJr7-LTLAhWBsIMKHRutBBIQFggrMAI&url=https%3A%2F%2Fwww.erasmusplus.org.uk%2Ffile%2F272%2Fdownload&usg=AFQjCNF6PUyCeOrCNbcoBZ-ZVQL0mzZ_mw.
[9] Faradilla, D., & Johar, R. J. (2017). Analysis of students’ ability in solving graph problems[M]. Proceedings of AICS-Social Sciences,Sumatera, Zndonesia,7-15.
[10] 顾小清, 张进良, 蔡慧英.(2012).学习分析:正在浮现中的数据技术[J]. 远程教育杂志,(1):18-25.
[11] Greiff, S., Wüstenberg, S., Holt, D. V., Goldhammer, F., & Funke, J.(2013). Computer-based assessment of complex problem solving:Concept, implementation, and application[J]. Educational Technology Research and Development, 61(3): 407-421.
[12] Greiff, S., & Scherer, R. (2018) Complex problem solving and its position in the wider realm of the human intellect[J]. Journal of Intelligence,(6):1-5.
[13] Heppner, P. P., & Petersen, C. H.(1982). The development and implications of a personal problem-solving inventory[J]. Journal of Counseling Psychology, 29(1): 66.
[14] Hertzum, M., Hansen, K. D., & Andersen, H. H.(2009). Scrutinising usability evaluation: Does thinking aloud affect behaviour and mental workload?[J].Behaviour & Information Technology, 28(2): 165-181.
[15] Hertzum, M., Hansen, K. D., & S￠nderstrup-Andersen, H. H. (2009). Which is the better prompt in thinking-aloud studies[A]. Aarhus Universitet. Institut for Matematiske Fag[C]. PB: Datalogisk Afdeling, 30-33.
[16] Heeter, C., Lee, Y. -H., Medler, B., & Magerko, B.(2013). Conceptually meaningful metrics: Inferring optimal challenge and mindset from gameplay game analytics[A]. In M. S. El-Nasr, A. Drachen, & A. Canossa (Eds.), Game analytics: Maximizing the value of player data[C]. Berlin, Germany: Springer-Verlag, 731-762.
[17] Jeong, A.(2005). A guide to analyzing message-response sequences and group interaction patterns in computer-mediated communication[J]. Distance education, 26(3): 367-383.
[18] Jacobson, M. J.(2013). Problem solving about complex systems: Differences between experts and novices[A]. In Proceedings of the 4th International Conference of the Learning Sciences. Mahwah, NJ: Erlbaum , 14-21.
[19] Jonassen, D. H.(2011). Design problems for secondary students[R]. Utah: National Center for Engineering and Technology Education.
[20] Keen, R.(2011). The development of problem solving in young children: A critical cognitive skill[J]. Annual review of psychology,(62): 1-21.
[21] Leshner, A. F., Tom, S. R., & Kern, R. S.(2013). Errorless learning and social problem solving ability in schizophrenia: An examination of the compensatory effects of training[J]. Psychiatry research, 206(1): 1-7.
[22] Luger, G. F.(2005). Artificial intelligence: Structures and strategies for complex problem solving[M]. Pearson education.
[23] MacNeill, S.(2012). Analytics: What is changing and why does it matter[J/OL]. CETIS Analytics Series, 1(1). http://publications.cetis.org.uk/wp-content/uploads/2012/11/Analytics-Vol1-No1-Briefing-Paper-online.pdf.
[24] Mandinach, E. B., & Gummer, E. S.(2013). A systemic view of implementing data literacy in educator preparation[J]. Educational Researcher, 42(1): 30-37.
[25] Mayer C., & Mayer, E.(1992). Putting general education to work: The key competencies report[R]. Australia: Australian Education Council and Ministers for Vocational Education, Employment and Training.
[26] Montague, M., & Applegate, B.(1993). Middle school students’ mathematical problem solving: An analysis of think-aloud protocols[J]. Learning Disability Quarterly, 16(1): 19-32.
[27] Newell, A., & Simon, H. A.(1972). Human problem solving [M]. Englewood Cliffs, NJ: Prentice-Hall.
[28] Nichols, P. D. (1994). A framework for developing cognitively diagnostic assessments [J]. Review of Educational Research, 64(4): 575-603.
[29] Peng, Y., & Reggia, J. A.(2012). Abductive inference models for diagnostic problem-solving[M]. Springer Science & Business Media.
[30] Phillips, R., Maor, D., Cumming-Potvin, W., Roberts, P., Herrington, J., Preston, G., Moore, E. & Perry, L.(2011). Learning analytics and study behaviour: A pilot study[A]. In Williams, P. Statham, N. Brown & B. Cleland (Eds.), Changing Demands, Changing Directions[C]. Proceedings ascilite Hobart, 997-1007.
[31] Polya, G.(1981). Mathematical discovery: On understanding, learning, and teaching problem solving[M].New York: Wiley.
[32] Preckel, F., & Thiemann, H.(2003). Online-versus paper-pencil version of a high potential intelligence test[J]. Swiss Journal of Psychology/Schweizerische Zeitschrift für Psychologie/Revue Suisse de Psychologie, 62(2): 131.
[33] Ray, A., & Margaret, W.(2003). Programme for international student assessment (PISA): PISA 2000 Technical Report[R]. OECD Publishing.
[34] Schmidt, R., & Housen, K.(1995). Problem solving with dimensional analysis [J].Physics Today, 48(7): 21-25.
[35] Siemens, G., & Baker, R. S.(2012). Learning analytics and educational data mining: Towards communication and collaboration[A]. In Proceedings of the 2nd international conference on learning analytics and knowledge. 252-254.
[36] Sinnott, J. D.(1989). A model for solution of ill-structured problems: Implications for everyday and abstract problem solving[M]. Praeger Publishers.
[37] Slade, S., & Prinsloo, P.(2013). Learning analytics ethical issues and dilemmas[J]. American Behavioral Scientist, 57(10): 1510-1529.
[38] Silver, E. A.(2013). Teaching and learning mathematical problem solving: Multiple research perspectives[M]. Routledge.
[39] Smith, V. C., Lange, A., & Huston, D. R.(2012). Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses[J]. Journal of Asynchronous Learning Networks, 16(3): 51-61.
[40] Sternberg, R. J., & Frensch, P. A.(2014). Complex problem solving: Principles and mechanisms[M]. Psychology Press.
[41] Trilling, B., & Fadel, C.(2009). 21st century skills: Learning for life in our times[M]. John Wiley & Sons.
[42] Venkataraman, B.(2009). Education for sustainable development[J]. Environment: Science and Policy for Sustainable Development, 51(2): 8-10.
[43] 张春与(1997).现代心理学[M]. 台北:华东书局.
[2] Artz, A. F., & Armour-Thomas, E.(1992). Development of a cognitive-metacognitive framework for protocol analysis of mathematical problem solving in small groups[J]. Cognition and instruction, 9(2): 137-175.
[3] Bozoki, A., Radovanovic, M., Winn, B., Heeter, C., & Anthony, J. C.(2013). Effects of a computer-based cognitive exercise program on age-related cognitive decline[J]. Archives of Gerontology and Geriatrics, 57(1): 1-7.
[4] Chandrasekaran, B. (1990). Design problem solving: A task analysis[J]. AI magazine, 11(4): 59.
[5] 陈雪枫, 张厚粲(1998). 认知速度在智力结构中重要性的发展研究[J]. 心理科学, 21(6): 485-574.
[6] Culbertson, W. C., & Zillmer, E. A.(1998). The construct validity of the Tower of London DX as a measure of the executive functioning of ADHD children[J]. Assessment, 5(3): 215-226.
[7] D’Zurilla, T. J., & Goldfried, M. R.(1971). Problem solving and behavior modification[J]. Journal of abnormal psychology, 78(1): 107.
[8] EUROPEA(2006). Key Competences for Lifelong Learning-A European Reference [EB/OL]. [2006-12-30]. https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=3&cad=rja&uact=8&ved=0ahUKEwiimJr7-LTLAhWBsIMKHRutBBIQFggrMAI&url=https%3A%2F%2Fwww.erasmusplus.org.uk%2Ffile%2F272%2Fdownload&usg=AFQjCNF6PUyCeOrCNbcoBZ-ZVQL0mzZ_mw.
[9] Faradilla, D., & Johar, R. J. (2017). Analysis of students’ ability in solving graph problems[M]. Proceedings of AICS-Social Sciences,Sumatera, Zndonesia,7-15.
[10] 顾小清, 张进良, 蔡慧英.(2012).学习分析:正在浮现中的数据技术[J]. 远程教育杂志,(1):18-25.
[11] Greiff, S., Wüstenberg, S., Holt, D. V., Goldhammer, F., & Funke, J.(2013). Computer-based assessment of complex problem solving:Concept, implementation, and application[J]. Educational Technology Research and Development, 61(3): 407-421.
[12] Greiff, S., & Scherer, R. (2018) Complex problem solving and its position in the wider realm of the human intellect[J]. Journal of Intelligence,(6):1-5.
[13] Heppner, P. P., & Petersen, C. H.(1982). The development and implications of a personal problem-solving inventory[J]. Journal of Counseling Psychology, 29(1): 66.
[14] Hertzum, M., Hansen, K. D., & Andersen, H. H.(2009). Scrutinising usability evaluation: Does thinking aloud affect behaviour and mental workload?[J].Behaviour & Information Technology, 28(2): 165-181.
[15] Hertzum, M., Hansen, K. D., & S￠nderstrup-Andersen, H. H. (2009). Which is the better prompt in thinking-aloud studies[A]. Aarhus Universitet. Institut for Matematiske Fag[C]. PB: Datalogisk Afdeling, 30-33.
[16] Heeter, C., Lee, Y. -H., Medler, B., & Magerko, B.(2013). Conceptually meaningful metrics: Inferring optimal challenge and mindset from gameplay game analytics[A]. In M. S. El-Nasr, A. Drachen, & A. Canossa (Eds.), Game analytics: Maximizing the value of player data[C]. Berlin, Germany: Springer-Verlag, 731-762.
[17] Jeong, A.(2005). A guide to analyzing message-response sequences and group interaction patterns in computer-mediated communication[J]. Distance education, 26(3): 367-383.
[18] Jacobson, M. J.(2013). Problem solving about complex systems: Differences between experts and novices[A]. In Proceedings of the 4th International Conference of the Learning Sciences. Mahwah, NJ: Erlbaum , 14-21.
[19] Jonassen, D. H.(2011). Design problems for secondary students[R]. Utah: National Center for Engineering and Technology Education.
[20] Keen, R.(2011). The development of problem solving in young children: A critical cognitive skill[J]. Annual review of psychology,(62): 1-21.
[21] Leshner, A. F., Tom, S. R., & Kern, R. S.(2013). Errorless learning and social problem solving ability in schizophrenia: An examination of the compensatory effects of training[J]. Psychiatry research, 206(1): 1-7.
[22] Luger, G. F.(2005). Artificial intelligence: Structures and strategies for complex problem solving[M]. Pearson education.
[23] MacNeill, S.(2012). Analytics: What is changing and why does it matter[J/OL]. CETIS Analytics Series, 1(1). http://publications.cetis.org.uk/wp-content/uploads/2012/11/Analytics-Vol1-No1-Briefing-Paper-online.pdf.
[24] Mandinach, E. B., & Gummer, E. S.(2013). A systemic view of implementing data literacy in educator preparation[J]. Educational Researcher, 42(1): 30-37.
[25] Mayer C., & Mayer, E.(1992). Putting general education to work: The key competencies report[R]. Australia: Australian Education Council and Ministers for Vocational Education, Employment and Training.
[26] Montague, M., & Applegate, B.(1993). Middle school students’ mathematical problem solving: An analysis of think-aloud protocols[J]. Learning Disability Quarterly, 16(1): 19-32.
[27] Newell, A., & Simon, H. A.(1972). Human problem solving [M]. Englewood Cliffs, NJ: Prentice-Hall.
[28] Nichols, P. D. (1994). A framework for developing cognitively diagnostic assessments [J]. Review of Educational Research, 64(4): 575-603.
[29] Peng, Y., & Reggia, J. A.(2012). Abductive inference models for diagnostic problem-solving[M]. Springer Science & Business Media.
[30] Phillips, R., Maor, D., Cumming-Potvin, W., Roberts, P., Herrington, J., Preston, G., Moore, E. & Perry, L.(2011). Learning analytics and study behaviour: A pilot study[A]. In Williams, P. Statham, N. Brown & B. Cleland (Eds.), Changing Demands, Changing Directions[C]. Proceedings ascilite Hobart, 997-1007.
[31] Polya, G.(1981). Mathematical discovery: On understanding, learning, and teaching problem solving[M].New York: Wiley.
[32] Preckel, F., & Thiemann, H.(2003). Online-versus paper-pencil version of a high potential intelligence test[J]. Swiss Journal of Psychology/Schweizerische Zeitschrift für Psychologie/Revue Suisse de Psychologie, 62(2): 131.
[33] Ray, A., & Margaret, W.(2003). Programme for international student assessment (PISA): PISA 2000 Technical Report[R]. OECD Publishing.
[34] Schmidt, R., & Housen, K.(1995). Problem solving with dimensional analysis [J].Physics Today, 48(7): 21-25.
[35] Siemens, G., & Baker, R. S.(2012). Learning analytics and educational data mining: Towards communication and collaboration[A]. In Proceedings of the 2nd international conference on learning analytics and knowledge. 252-254.
[36] Sinnott, J. D.(1989). A model for solution of ill-structured problems: Implications for everyday and abstract problem solving[M]. Praeger Publishers.
[37] Slade, S., & Prinsloo, P.(2013). Learning analytics ethical issues and dilemmas[J]. American Behavioral Scientist, 57(10): 1510-1529.
[38] Silver, E. A.(2013). Teaching and learning mathematical problem solving: Multiple research perspectives[M]. Routledge.
[39] Smith, V. C., Lange, A., & Huston, D. R.(2012). Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses[J]. Journal of Asynchronous Learning Networks, 16(3): 51-61.
[40] Sternberg, R. J., & Frensch, P. A.(2014). Complex problem solving: Principles and mechanisms[M]. Psychology Press.
[41] Trilling, B., & Fadel, C.(2009). 21st century skills: Learning for life in our times[M]. John Wiley & Sons.
[42] Venkataraman, B.(2009). Education for sustainable development[J]. Environment: Science and Policy for Sustainable Development, 51(2): 8-10.
[43] 张春与(1997).现代心理学[M]. 台北:华东书局.