基于隐式用户行为库可用性测试模式的实例研究
|
摘要
可用性测试是可用性工程中的关键步骤,是评估界面系统用户体验的重要手段。本文通过研究当前主流的可用性测试方式,总结出其方法和理念上的特点,进而对一种隐式采集建立用户行为库的测试模式做了全面的研究。
对于隐式用户行为库可用性测试模式,本文首先对其数据库的建立流程进行了总结,将可用性、数据挖掘以及认知行为学的多种学科知识进行了融合。再通过一个具体的实例研究,建立一个用户行为库的雏形,对实例系统分别进行显示采集和隐式采集的可用性测试,将其结果和测试过程进行全方面的比对,从而总结出隐式采集的测试方式在可用性严重度的评估和用户行为群体的界定上,都具有非常重要的研究意义,最后,通过实例的结论得出该种新方法在目前技术手段下的优缺点和发展趋势。主要研究工作概括如下:
第一,本文首先通过研究现有的可用性开发实例项目,总结出建立一个基于隐式采集用户行为库的系统架构流程。
第二,进行隐性数据采集、挖掘和呈现,得到双屏笔记本的基础用户行为库,对其分别进行传统测试和隐式采集测试流程。
第三,对比两种测试结果,得出新型可用性测试模式的优缺点,对其中的难点热点问题进行了总结。
文章阐明了建立隐式采集用户行为库的普遍性结构,在其它功能体系设计中,同样可以参照本文的方法和结构,遵循以用户为中心的设计理念,建立全面细致的用户行为库。
Now, the usability has gradually entered the ranks of core competitiveness evaluation standard of domestic products. So far, the majority usability projects are built on the traditional testing methods, but due to the rapidly development of technology, the traditional tests has been a little out of tune with the advanced network technology.
A new type of model based on implicit collecting of user behavior has aroused widespread among major enterprises. This article is based on the Sideshow-Dual Screen laptop development conditions, through implicit data collection, combined with the guidance of the principle of usability of data mining technology, to establish a primary database of user behavior, and based on the research of user behavior database, to improve the user experience of Dual Screen laptop.
Work is as follows:
1. Deeply study the element and guideline of user experience, present a new approach of system design and evaluation, and suggest a dynamic model.
2. A hidden data collection, mining and has obtained Dual Screen notebook users the basis of the behavior of their respective traditional testing and test implicit acquisition process.
3. Compares the two test results, availability of a new test mode that the advantages and disadvantages of these difficult issues were summarized.
This article has explored and verified the test modes of implicit collecting of the user usability, and provided a first-hand data and valuable experience for future developments in the related-field.
对于隐式用户行为库可用性测试模式,本文首先对其数据库的建立流程进行了总结,将可用性、数据挖掘以及认知行为学的多种学科知识进行了融合。再通过一个具体的实例研究,建立一个用户行为库的雏形,对实例系统分别进行显示采集和隐式采集的可用性测试,将其结果和测试过程进行全方面的比对,从而总结出隐式采集的测试方式在可用性严重度的评估和用户行为群体的界定上,都具有非常重要的研究意义,最后,通过实例的结论得出该种新方法在目前技术手段下的优缺点和发展趋势。主要研究工作概括如下:
第一,本文首先通过研究现有的可用性开发实例项目,总结出建立一个基于隐式采集用户行为库的系统架构流程。
第二,进行隐性数据采集、挖掘和呈现,得到双屏笔记本的基础用户行为库,对其分别进行传统测试和隐式采集测试流程。
第三,对比两种测试结果,得出新型可用性测试模式的优缺点,对其中的难点热点问题进行了总结。
文章阐明了建立隐式采集用户行为库的普遍性结构,在其它功能体系设计中,同样可以参照本文的方法和结构,遵循以用户为中心的设计理念,建立全面细致的用户行为库。
Now, the usability has gradually entered the ranks of core competitiveness evaluation standard of domestic products. So far, the majority usability projects are built on the traditional testing methods, but due to the rapidly development of technology, the traditional tests has been a little out of tune with the advanced network technology.
A new type of model based on implicit collecting of user behavior has aroused widespread among major enterprises. This article is based on the Sideshow-Dual Screen laptop development conditions, through implicit data collection, combined with the guidance of the principle of usability of data mining technology, to establish a primary database of user behavior, and based on the research of user behavior database, to improve the user experience of Dual Screen laptop.
Work is as follows:
1. Deeply study the element and guideline of user experience, present a new approach of system design and evaluation, and suggest a dynamic model.
2. A hidden data collection, mining and has obtained Dual Screen notebook users the basis of the behavior of their respective traditional testing and test implicit acquisition process.
3. Compares the two test results, availability of a new test mode that the advantages and disadvantages of these difficult issues were summarized.
This article has explored and verified the test modes of implicit collecting of the user usability, and provided a first-hand data and valuable experience for future developments in the related-field.
引文
【1】 ANUP KUMR,RAJPAKALA,R.K.RAGADE.THE VIRTUAL LEARNING ENVIRONMENT SYSTEM.Proceedings of the 1998 FIE Conference,IEEE 1998,711-716
【2】 胡侃夏绍玮基于大型数据仓库的数据采掘研究综述[J].软件学报.1998年第9卷第1期
【3】 程永军,网络化虚拟学习环境研究计算机与网络,2002.08
【4】 B.Bloom.The 2 sigma problem:The search for methods of group instruction as effective as one-to-one tutoring.Educational Researcher,13(6),1984,4-16
【5】 B.约瑟夫.派恩,詹姆斯.H.吉尔摩.体验经济.夏业良等 鲁炜译.第1版.机械工业出版社,2002.5
【6】 Donald A.Norman.情感化设计.北京:电子工业出版社,2005
【7】 Houde.S,Hill.What Do Prototypes Prototype? Handbook of Human-Computer Interaction.Second,completely revised edition.Elsevier Science B.V,1997,367-381
【8】 Forlizzi,J.Ford,S.The Building Blocks of Experience:An Early Framework for Interaction Designer,In proceedings of the DIS 2000seminar.Communications of the ACM,2000,419-423 Robert Rubinoff
【9】 Robert Rubinoff.How To Quantify The User Experience.2004.4
【10】 Andrew Perkis,Solveig Munkeby,Odd Inge Hillestad.A model for measuring Quality of Experience.Center for Quantifiable Quality of Service in Communication Systems.IEEE Press,2006,198-201
【11】[美]JAKOB NIELSEN.可用性工程.刘正捷译.机械工业出版社,2004.9
【12】 Wing-Kwong Wong1,Bo-Yu Chan1,Sheng-Kai Yin.A Dynamic Geometry Environment for Learning Theorem Proving.Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies(ICALT' 05),2005IEEE
【13】[美]David H.Jonassen & Susan M.Land.学习环境的理论基础[M].郑太年,任友群译.华东师范大学出版社,2002
【14】 Brown,J.S.,Collins,A.& Duguid,S.(1989).Situated cognition and the culture of learning.Educational Researcher,18(1),32-42
【15】 Herrington,J.,& Oliver,R.(2000).An instructional design framework for authentic learning environments[J].Educational Technology Research and Developmen,48(3):23-48
【16】 Barry Kort,Rob Reilly,Rosalind W.Picard.An Affective Model of Interplay Between Emotions and Learning:Reengineering Educational Pedagogy-Building a Learning Companion.IEEE Press,2001,43-46
【17】 Brent Wilson,Peggy Cole.A review of cognitive teaching models.Educational Technology Research and Development,39(4),1991,47-64
【18】[美]Alan Cooper,Robert M.Reimann.软件观念革命——交互设计精髓About Face 2.0:The Essentials of Interaction Design.詹剑锋,张知非译.电子工业出版社,2005.5
【19】 Ben Shneiderman.Design the User Interface-Strategies for Effective human-Computer Interaction,2004.3
【20】 Michel Beaudouin-Lafon.Instrumental Interaction:An Interaction Model for Designing Post-W1MP User Interfaces,CHI 2000.
【21】 Glenna A Satalich.Navigation and Wayfinding in Virtual Reality:Finding the Proper Tools and Cues to Enhance Navigational Awareness.University of Washington,1995
【22】 C.Russo Dos Santos,P.Gros,P.Abel.Metaphor-Aware 3D Navigation.Proceedings of the IEEE Symposium on Information Visualization 2000(InfoVis'00),IEEE 2000
【23】[美]鲍曼(Bowman,D.A.)等著,张凤军等译.三维用户界面:理论与实践——国外计算机科学教材系列,2006
【24】 侯文君,吕菲,高歌.张凤军.三维虚拟环境中用户交互行为及用户体验研究.机电产品开发与创新,2007
【25】 G.Fischer,E.Arias,H.Eden,A.Gorman,and E.Scharff.Transcending the individual human mind-creating shared understanding through collaborative design.ACM Transaction on Computer-Human Interaction (TOCHI),2000,84-113
【26】 李翠白.西方情境学习理论的发展与应用反思.电化教育研究,E-education Research, 2006, 20-24
[27] 易用伟业计算机应用技术有限公司.EON Studio快速入门指南(内部教材).
[28] Noritaka OSAWA, Kikuo ASAI, Fumihiko SAITO. An Interactive Toolkit Library for 3D Applications: it3d. Eighth Eurographics Workshop on Virtual Environments (2002), 149-157
[29] PHILIP BARNARD, JON MAY, DAVID DUKE, Systems, Interactions, and Macrotheory. ACM Transactions on Computer-Human Interaction, Vol. 7, No. 2, June 2000, 222-262
[30] Gregory M. Nielson, Dan R. Olsen Jr. Direct Manipulation Techniques for 3D Objects Using 2D Locator Devices. 1986 WORKSHOP ON INTERACTIVE 3D GRAPHICS, OCTOBER 23-24. 1986 ,175-182
[31] Philip Cohen, David McGee, Sharon Oviatt. Multimodal Interaction for 2D and 3D Environments. 1999 IEEE, July/August 1999,10-13
[32] Cockburn, A. and McKenzie, B. Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments. CHI 2002, April 20-25, 2002.
[33] Cockburn, A. and McKenzie, B. Evaluating the Effect of the Third Dimension in a Document Management System. SIGCHI'01, March 31-April 4, 2001, Seattle, WA, USA.
[34] Furnas, G. W. The FISHEYE view: a new look at structured files. Bell Laboratories Technical Memorandum #81-11221-9, October 12, 1981.
[35] Robertson, G. Czerwinski, M. and Larson, K. Data Mountain: Using Spatial Memory for Document Management, proc. of UIST'02, pp. 153-162, 2002.
[36] Risden, K., Czerwinski, M., Munzner, T. and Cook, D. An Initial Examination of Ease of Use for 2D and 3D Information Visualizations of Web Content. Int. J. Human-Computer Studies, 53, 695-714. 2000.
[37] Robertson, G., Mackinlay, J., and Card, S. K. Cone Trees: Animated 3D visualizations of hierarchical information. In Proceedings of CHI'91, New Orleans,May 1991, ACM Press, 189-194.
[38] A. Sutcliffe and U. Patel, "3D or Not 3D: Is It Nobler in the Mind?" People and Computers: Proc. 1996 British Human - Computer Interaction Conf., Cambridge Univ.Press, 1996, pp. 79-94.
[39] K. Risden et al., "An Initial Examination of Ease of Use for 2D and 3D Information Visualizations of Web Content, " Int'; J. Human - Computer Studies, vol. 53, no. 5, Nov. 2000, pp. 695-714.
[40] A. Cockburn and B. McKenzie, "Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments," Proc. ACM Computer - Human Interaction Conf. Human Factors in Computing Systems, ACM Press, 2002, 203-210.
【2】 胡侃夏绍玮基于大型数据仓库的数据采掘研究综述[J].软件学报.1998年第9卷第1期
【3】 程永军,网络化虚拟学习环境研究计算机与网络,2002.08
【4】 B.Bloom.The 2 sigma problem:The search for methods of group instruction as effective as one-to-one tutoring.Educational Researcher,13(6),1984,4-16
【5】 B.约瑟夫.派恩,詹姆斯.H.吉尔摩.体验经济.夏业良等 鲁炜译.第1版.机械工业出版社,2002.5
【6】 Donald A.Norman.情感化设计.北京:电子工业出版社,2005
【7】 Houde.S,Hill.What Do Prototypes Prototype? Handbook of Human-Computer Interaction.Second,completely revised edition.Elsevier Science B.V,1997,367-381
【8】 Forlizzi,J.Ford,S.The Building Blocks of Experience:An Early Framework for Interaction Designer,In proceedings of the DIS 2000seminar.Communications of the ACM,2000,419-423 Robert Rubinoff
【9】 Robert Rubinoff.How To Quantify The User Experience.2004.4
【10】 Andrew Perkis,Solveig Munkeby,Odd Inge Hillestad.A model for measuring Quality of Experience.Center for Quantifiable Quality of Service in Communication Systems.IEEE Press,2006,198-201
【11】[美]JAKOB NIELSEN.可用性工程.刘正捷译.机械工业出版社,2004.9
【12】 Wing-Kwong Wong1,Bo-Yu Chan1,Sheng-Kai Yin.A Dynamic Geometry Environment for Learning Theorem Proving.Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies(ICALT' 05),2005IEEE
【13】[美]David H.Jonassen & Susan M.Land.学习环境的理论基础[M].郑太年,任友群译.华东师范大学出版社,2002
【14】 Brown,J.S.,Collins,A.& Duguid,S.(1989).Situated cognition and the culture of learning.Educational Researcher,18(1),32-42
【15】 Herrington,J.,& Oliver,R.(2000).An instructional design framework for authentic learning environments[J].Educational Technology Research and Developmen,48(3):23-48
【16】 Barry Kort,Rob Reilly,Rosalind W.Picard.An Affective Model of Interplay Between Emotions and Learning:Reengineering Educational Pedagogy-Building a Learning Companion.IEEE Press,2001,43-46
【17】 Brent Wilson,Peggy Cole.A review of cognitive teaching models.Educational Technology Research and Development,39(4),1991,47-64
【18】[美]Alan Cooper,Robert M.Reimann.软件观念革命——交互设计精髓About Face 2.0:The Essentials of Interaction Design.詹剑锋,张知非译.电子工业出版社,2005.5
【19】 Ben Shneiderman.Design the User Interface-Strategies for Effective human-Computer Interaction,2004.3
【20】 Michel Beaudouin-Lafon.Instrumental Interaction:An Interaction Model for Designing Post-W1MP User Interfaces,CHI 2000.
【21】 Glenna A Satalich.Navigation and Wayfinding in Virtual Reality:Finding the Proper Tools and Cues to Enhance Navigational Awareness.University of Washington,1995
【22】 C.Russo Dos Santos,P.Gros,P.Abel.Metaphor-Aware 3D Navigation.Proceedings of the IEEE Symposium on Information Visualization 2000(InfoVis'00),IEEE 2000
【23】[美]鲍曼(Bowman,D.A.)等著,张凤军等译.三维用户界面:理论与实践——国外计算机科学教材系列,2006
【24】 侯文君,吕菲,高歌.张凤军.三维虚拟环境中用户交互行为及用户体验研究.机电产品开发与创新,2007
【25】 G.Fischer,E.Arias,H.Eden,A.Gorman,and E.Scharff.Transcending the individual human mind-creating shared understanding through collaborative design.ACM Transaction on Computer-Human Interaction (TOCHI),2000,84-113
【26】 李翠白.西方情境学习理论的发展与应用反思.电化教育研究,E-education Research, 2006, 20-24
[27] 易用伟业计算机应用技术有限公司.EON Studio快速入门指南(内部教材).
[28] Noritaka OSAWA, Kikuo ASAI, Fumihiko SAITO. An Interactive Toolkit Library for 3D Applications: it3d. Eighth Eurographics Workshop on Virtual Environments (2002), 149-157
[29] PHILIP BARNARD, JON MAY, DAVID DUKE, Systems, Interactions, and Macrotheory. ACM Transactions on Computer-Human Interaction, Vol. 7, No. 2, June 2000, 222-262
[30] Gregory M. Nielson, Dan R. Olsen Jr. Direct Manipulation Techniques for 3D Objects Using 2D Locator Devices. 1986 WORKSHOP ON INTERACTIVE 3D GRAPHICS, OCTOBER 23-24. 1986 ,175-182
[31] Philip Cohen, David McGee, Sharon Oviatt. Multimodal Interaction for 2D and 3D Environments. 1999 IEEE, July/August 1999,10-13
[32] Cockburn, A. and McKenzie, B. Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments. CHI 2002, April 20-25, 2002.
[33] Cockburn, A. and McKenzie, B. Evaluating the Effect of the Third Dimension in a Document Management System. SIGCHI'01, March 31-April 4, 2001, Seattle, WA, USA.
[34] Furnas, G. W. The FISHEYE view: a new look at structured files. Bell Laboratories Technical Memorandum #81-11221-9, October 12, 1981.
[35] Robertson, G. Czerwinski, M. and Larson, K. Data Mountain: Using Spatial Memory for Document Management, proc. of UIST'02, pp. 153-162, 2002.
[36] Risden, K., Czerwinski, M., Munzner, T. and Cook, D. An Initial Examination of Ease of Use for 2D and 3D Information Visualizations of Web Content. Int. J. Human-Computer Studies, 53, 695-714. 2000.
[37] Robertson, G., Mackinlay, J., and Card, S. K. Cone Trees: Animated 3D visualizations of hierarchical information. In Proceedings of CHI'91, New Orleans,May 1991, ACM Press, 189-194.
[38] A. Sutcliffe and U. Patel, "3D or Not 3D: Is It Nobler in the Mind?" People and Computers: Proc. 1996 British Human - Computer Interaction Conf., Cambridge Univ.Press, 1996, pp. 79-94.
[39] K. Risden et al., "An Initial Examination of Ease of Use for 2D and 3D Information Visualizations of Web Content, " Int'; J. Human - Computer Studies, vol. 53, no. 5, Nov. 2000, pp. 695-714.
[40] A. Cockburn and B. McKenzie, "Evaluating the Effectiveness of Spatial Memory in 2D and 3D Physical and Virtual Environments," Proc. ACM Computer - Human Interaction Conf. Human Factors in Computing Systems, ACM Press, 2002, 203-210.