Do Teams Achieve Usability Goals? Evaluating Goal Achievement with Usability Goals Setting Tool

详细信息    查看全文

• 作者：Anirudha Joshi (1) anirudha@iitb.ac.in
  N. L. Sarda (1) nls@iitb.ac.in
• 关键词：Usability goals achievement &#8211 ; usability goal parameters &#8211 ; latent goals &#8211 ; design tools &#8211 ; methods
• 刊名：Lecture Notes in Computer Science
• 出版年：2011
• 出版时间：2011
• 年：2011
• 卷：6946
• 期：1
• 页码：313-330
• 全文大小：461.2 KB
• 参考文献：1. Nielsen, J.: Usability Engineering, pp. 26–37. Morgan Kaufmann, San Francisco (1993)
  2. International Organization for Standardization: ISO 9241-1:1997 Ergonomic Requirements for Office Work with Visual Display Terminals (1997)
  3. Mayhew, D.: Usability Engineering Lifecycle, pp. 123–145. Morgan Kaufmann, San Francisco (1999)
  4. International Organization for Standardization: ISO/IEC 9126-1:2001 Software Engineering - Product Quality (2001)
  5. Preece, J., Rogers, Y., Sharp, H.: Interaction Design, Beyond Human-Computer Interaction, 1st edn., pp. 13–20. John Wiley & Sons, Chichester (2002)
  6. Cooper, A., Reimann, R.: About Face 2.0, pp. 64–67. Wiley, Chichester (2003)
  7. Shneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction, 4th edn., p. 14. Addison Wesley, Reading (2004)
  8. Bevan, N.: Classifying and Selecting UX and Usability Measures. In: International Workshop on Meaningful Measures: Valid Useful User Experience Measurement (2008)
  9. Hornb忙k, K., Fr酶kj忙r, E.: Making Use of Business Goals in Usability Evaluation: An Experiment with Novice Evaluators. In: CHI, Florence (2008)
  10. Joshi, A.: Usability Goals Setting Tool. In: 4th Workshop on Software and Usability Engineering Cross-Pollination: Usability Evaluation of Advanced Interfaces, Uppsala (2009)
  11. Joshi, A.: Usability Goals Setting Tool - Online Version, http://www.idc.iitb.ac.in/~anirudha/ugt.htm (accessed 2009)
  12. Eames, C.: Charles Eames Quotes. In: BrainyQuote.com, http://www.brainyquote.com/quotes/quotes/c/charleseam169187.html
  13. Archer, B.: Systematic Method for Designers. Council of Industrial Design (1965)
  14. Law, E., Roto, V., Hassenzahl, M., Vermeeren, A., Kort, J.: Understanding, Scoping and Defining User eXperience: A Survey Approach. In: CHI 2009 (2009)
  15. McCarthy, J., Wright, P.: Technology as Experience, pp. 49–129. The MIT Press, Cambridge (2004)
  16. Cross, N.: Engineering Design Methods, 3rd edn., pp. 61–76. John Wiley & Sons, Chichester (2000)
  17. Joshi, A., Sarda, N., Tripathi, S.: Measuring Effectiveness of HCI Integration in Software Development Processes. Journal of Software Systems (2010), doi:10.1016/j.jss.2010.03.078
  18. Joshi, A., Sarda, N.: Evaluating Relative Contributions of Various HCI Activities to Usability. In: Human-Centred Software Engineering, Reykjavik (2010)
  19. Hatcher, L.: A Step-by-Step Approach to Using the SAS System for Factor Analysis and Structural Equation Modeling, pp. 131–140. SAS Publishing (1994)
  20. Kurtz, N.: Introduction to Social Statistics, pp. 270–275. McGraw Hill Book Company, New York (1983)
• 作者单位：1. Indian Institute of Technology, Bombay, India
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence and Robotics
  Computer Communication Networks
  Software Engineering
  Data Encryption
  Database Management
  Computation by Abstract Devices
  Algorithm Analysis and Problem Complexity
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1611-3349

文摘

Do teams achieve important usability goals most of the time? Further, is goal achievement uniform or are practitioners more mindful of some goals than others? This paper presents an empirical study on usability goal achievement in industry projects. We used Usability Goal setting Tool (UGT), a recommender system that helps teams set, prioritize, and evaluate usability goals. The practitioner creates profiles for the product and its users. Based on these inputs, UGT helps the practitioner break down high-level usability goals into more specific goal parameters and provides recommendations, examples, and guidelines to assign weights to these parameters. UGT suggests strategies to evaluate goal parameters after the design is ready and assign them scores. UGT was used to collect data from 65 projects in the Indian software industry in which participants assigned weights and scores to the goal parameters. The 30 goal parameters suggested by UGT were found to be internally reliable, and having acceptable granularity and coverage. It was observed that goal parameter weights and scores correlated, but only moderately. Another interesting observation was that more than a third of the important goal parameters did not score well. We identify eight goal parameters that are typically high-weighted but have poor weight-score correlations. We call these “latent but important” goal parameters. Design teams will do well to pay closer attention to these goal parameters during projects.