Improving Peer Assessment Modeling of Teacher’s Grades, The Case of OpenAnswer

详细信息    查看全文

• 关键词：Automatic correction of OpenAnswers ; Peer assessment modeling ; Bayesian networks
• 刊名：Lecture Notes in Computer Science
• 出版年：2017
• 出版时间：2017
• 年：2017
• 卷：10108
• 期：1
• 页码：601-613
• 丛书名：Emerging Technologies for Education
• ISBN：978-3-319-52836-6
• 卷排序：10108

文摘

Questions with answers are rarely used as e-learning assessment tools because of the resulting high workload for the teacher/tutor that should grade them, which can be mitigated by doing peer-assessment. In OpenAnswer we modeled peer-assessment as a Bayesian network connecting the sub-networks representing any participating student to the corresponding answers of her graded peers. The model has shown good ability to predict (without further info from the teacher) the exact teacher’s grade (ground truth) from the peer grades only, and a very good ability to predict it within 1 mark from the right one. In this paper we explore changes to the OpenAnswer model to improve its predictions. The experimental results, obtained by simulating teacher’s grading on real datasets, show the improved predictions.