摘要
目的为了查找系统中存在的问题,提升系统的可用性,对一套航天员虚拟训练系统进行可用性评估。方法设计了一份可用性主观问卷,综合运用用户测试法、事后问卷调查法和访谈法,从任务绩效、易学性、易用性、交互性、沉浸感、学习有效性、舒适性、满意度及副作用等指标开展实验研究。结果系统在任务绩效测试中已满足基本要求;易学性、易用性、交互性、沉浸感、学习有效性等指标显著高于中值3分,副作用程度较低,具备较好的可用性。结合访谈结果,对系统中存在的问题进行了挖掘,获得系统开发人员较高认可度,可为系统改进提供参考。结论该评估实验可为系统可用性的提升提供指导。
Objective To find the potential problems of the system and to improve its usability,the usability evaluation of an astronaut virtual training system was conducted. Methods A subjective questionnaire of usability was designed. The user test,the post-hoc questionnaire and the interview methods were adopted to study the system usability in the aspects of performance,easiness of learning,easiness of use,interaction,sense of immersion,learning effectiveness,comfort,satisfaction,and side-effect etc. Results The system met the basic requirements in the task performance test. The easiness of learning,easiness of use,interaction,sense of immersion,and learning effectiveness were all significantly higher than the median 3 points,and the degree of side-effect was low. The usability of this system was good. In addition,the usability problems were recognized and most of them were accepted by the system developer which may serve as a good reference for further system improvement. Conclusion The evaluation experiment could be used as a guideline for system improvement.
引文
[1]R9nkk9 J,Markkanen J,Launonen R,et al.Multimodal astronaut virtual training prototype[J].International Journal of Human-Computer Studies,2006,64(3):182-191.
[2]Blackledge J,Barrett M.Development and evaluation of a desktop VR system for electrical services engineers[C]//International Association of Engineers:ICEEE12,London,2012.
[3]林一,陈靖,刘越,等.基于心智模型的虚拟现实与增强现实混合式移动导览系统的用户体验设计[J].计算机学报,2015,38(2):408-422.Lin Y,Chen J,Liu Y,et al.User experience design of VR AR hybrid mobile browsing system based on mental model[J].Chinese Journal of Computers,2015,38(2):408-422.
[4]Kennedy RS,Lane NE,Berbaum KS,et al.Simulator sickness questionnaire:An enhanced method for quantifying simulator sickness[J].The International Journal of Aviation Psychology,1993,3(3):203-220.
[5]Kirakowski J,Corbett M.SUMI:The software usability measurement inventory[J].British Journal of Educational Technology,1993,24(3):210-212.
[6]Witmer BG.Measuring presence in virtual environments:a presence questionnaire[J].Presence,1998,7(3):225-240.
[7]Barfield W,Baird KM,Bjorneseth OJ.Presence in virtual environments as a function of type of input device and display update rate[J].Displays,1998,19(2):91-98.
[8]Kalawsky RS.VRUSE—a computerised diagnostic tool:for usability evaluation of virtual/synthetic environment systems[J].Applied ergonomics,1999,30(1):11-25.
[9]Dalgarno B,Hedberg JG,Harper B.The contribution of 3D environments to conceptual understanding.[J].Unitec Institute of Technology,2002:149-158.
[10]Chou SW,Liu CH.Learning effectiveness in a Web-based virtual learning environment:a learner control perspective[J].Journal of Computer Assisted Learning,2005,21(1):65-76.
[11]Lee AL,Wong KW,Fung CC.How does desktop virtual reality enhance learning outcomes?A structural equation modeling approach[J].Computers&Education,2010,55(4):1424-1442.
[12]Bouchard S,Robillard G,Renaud P.Revising the factor structure of the Simulator Sickness Questionnaire[C]//Annual Review of Cybertherapy and Telemedicine,2007,5:128-137.
[13]Stanney KM,Kennedy RS.Simulation Sickness[M].Human factors in simulation and training,CRC Press,2008:117.
[14]Rebelo F,Noriega P,Duarte E,et al.Using virtual reality to assess user experience[J].Human Factors the Journal of the Human Factors&Ergonomics Society,2012,54(6):964-982.
[15]Sharples S,Burnett G,Cobb S.Sickness in Virtual Reality[M]//Wiederhold BK,Bouchard S.Advances in Virtual Reality and Anxiety Disorders,New York:Springer Science,2014:35-62.