远程游戏系统自动化测试过程研究与应用
摘要
随着软件业的不断发展,软件测试成为软件开发周期至关重要的一环,并且从多方面的优势可以证明自动化软件测试可以极大地提高软件测试的效率,节约软件测试的成本。
在研究传统的自动化测试方法和技术的基础上,对手工测试和自动化测试进行了比较分析;针对英特尔公司数字家庭实验室的远程游戏系统项目,对自动化测试生存周期方法学(ATLM)模型进行了改进,提出了更加实用高效的远程游戏系统自动化测试过程模型,重点论述了自动化测试过程模型的四个阶段,即自动化测试的决定、自动化测试需求分析、自动化测试的实现,自动化测试的管理。
通过将自动化测试过程模型应用于远程游戏系统的自动化测试实践中,分析此模型在自动化测试应用中的实用性和高效性。在远程游戏系统的自动化测试决定阶段确定了项目背景及自动化测试的必要性。在需求分析阶段确定了远程游戏系统的自动化测试需求程度,自动化测试工具和自动化测试环境。在实现阶段充分运用了自动化测试的两种关键技术脚本技术和自动化测试框架实现了对远程游戏系统多个测试模块的自动化测试。并对自动化测试脚本的设计和编写进行了详细的描述,阐述了自动化测试模块和自动化测试框架的详细设计和实施办法。在管理阶段实现了对自动化测试系统进行应用、测试和评审,总结了在自动化测试过程中遇到的各种问题和解决办法,对自动化测试系统的工作效率和收益回报进行了评估,并对进一步完善自动化测试框架提出期望。
With the development of software industry,it is much more important for the status of software test in the procedure of software development and further more we can prove that the efficiency of software test was largely improved and the cost was saved by automated test by its advantages of many aspects.
According to the research of traditional software test methods and technologies, compares handwork test with automated test and analyzes the differences between them. Basing on Remote Gaming system developed by Intel Company Digital Home Lab, improves ATLM and puts forward a more efficient and practical process model for automated test, mainly illuminates the four phases in the model, including decision, requirement analysis, implementation and management.
Through the application of automated test process model in the automated test of Remote Gaming system, analyzes its practicability and high-efficiency. At the decision step, confirms the background of Remote Gaming system and the necessity of automated test. At the requirement analysis step, confirms the requiring degree of automated test and prepares the tools and environment for automated test. At the implementation step, makes good use of the two key technologies scripts and automated test framework, describes the design and compilation of scripts, gives the detailed design and implementation methods of automated test modules and also illuminates the design and realization of automated test framework. At the management step, implements the application, testing and evaluation of automated test process, concludes the various problems in the process and the solvent of them, gives the evaluation of the efficiency and income of the process and also puts forward the expectation of improving the automated test framework.
在研究传统的自动化测试方法和技术的基础上,对手工测试和自动化测试进行了比较分析;针对英特尔公司数字家庭实验室的远程游戏系统项目,对自动化测试生存周期方法学(ATLM)模型进行了改进,提出了更加实用高效的远程游戏系统自动化测试过程模型,重点论述了自动化测试过程模型的四个阶段,即自动化测试的决定、自动化测试需求分析、自动化测试的实现,自动化测试的管理。
通过将自动化测试过程模型应用于远程游戏系统的自动化测试实践中,分析此模型在自动化测试应用中的实用性和高效性。在远程游戏系统的自动化测试决定阶段确定了项目背景及自动化测试的必要性。在需求分析阶段确定了远程游戏系统的自动化测试需求程度,自动化测试工具和自动化测试环境。在实现阶段充分运用了自动化测试的两种关键技术脚本技术和自动化测试框架实现了对远程游戏系统多个测试模块的自动化测试。并对自动化测试脚本的设计和编写进行了详细的描述,阐述了自动化测试模块和自动化测试框架的详细设计和实施办法。在管理阶段实现了对自动化测试系统进行应用、测试和评审,总结了在自动化测试过程中遇到的各种问题和解决办法,对自动化测试系统的工作效率和收益回报进行了评估,并对进一步完善自动化测试框架提出期望。
With the development of software industry,it is much more important for the status of software test in the procedure of software development and further more we can prove that the efficiency of software test was largely improved and the cost was saved by automated test by its advantages of many aspects.
According to the research of traditional software test methods and technologies, compares handwork test with automated test and analyzes the differences between them. Basing on Remote Gaming system developed by Intel Company Digital Home Lab, improves ATLM and puts forward a more efficient and practical process model for automated test, mainly illuminates the four phases in the model, including decision, requirement analysis, implementation and management.
Through the application of automated test process model in the automated test of Remote Gaming system, analyzes its practicability and high-efficiency. At the decision step, confirms the background of Remote Gaming system and the necessity of automated test. At the requirement analysis step, confirms the requiring degree of automated test and prepares the tools and environment for automated test. At the implementation step, makes good use of the two key technologies scripts and automated test framework, describes the design and compilation of scripts, gives the detailed design and implementation methods of automated test modules and also illuminates the design and realization of automated test framework. At the management step, implements the application, testing and evaluation of automated test process, concludes the various problems in the process and the solvent of them, gives the evaluation of the efficiency and income of the process and also puts forward the expectation of improving the automated test framework.
引文
[1] Kaner, Cem. Improving the Maintainability of Automated Test Suites. Software QA 4,NO. 4,1997: 134-137
[2] Mercury Interactive 李康. 如何在企业内部实现软件测试自动化[J]. 计算机应用, 2004, 16(10): 153-155
[3] The Software Engineering Institute, Carnegie Mellon University. Software Test Management: A Key Process Area for Level 2: Repeatable. www.sei.cmu.edu/cmm/ cmm-v2/test-mgt-kpa.htm: “Management Practices”:36-40
[4] Daniel J. Mosley, Bruce A. Posey. Just Enough Software Test Automation. Pearson Education, Inc.,2002:35-37
[5] Humphrey W.S. Managing the Software Process. Prentice Hall PTR, Addison-Wesley, Reading, MA,1989:98-103
[6] Bender, Richard. SEI/CMM Proposed Software Evaluation and Test KPA. Rev. 4, Bender and Associates, P.O.Box 849,Larkspur,CA 94977,April 1996:10-12
[7] Krause, Michael H.A Maturity Model for Automated Software Testing. Medical Device and Diagnostic Industry Magazine, December 1994:57-60
[8] Mosley, Daniel J. Client-Server Software Testing on the Desktop and the Web. Prentice Hall PTR, Upper Saddle River,NJ,1999:42-46
[9] Dustin, Elfriede, Jeff Rashka and John Paul. Automated Software Testing. Addison-Wesley, Reading, MA, 1999:31-35
[10] Power,Mike. Styles for Making Test Automation Work. Addison-Wesley, Reading, MA, 2001:55-61
[11] Stang, Richard. Data Driven Testing for Client/Server Applications. Fifth International Conference on Software Testing, Analysis and Reliability(STAR’96):395-400.
[12] Dustin E,Rashka J,Paul J.于秀山,胡兢玉, 等译.软件自动化测试: 引入、管理与实施[M].北京: 电子工业出版社, 2003:23-25
[13] Paul C. Jorgensen 著, 韩柯 等译. 软件测试(第二版)[M]. 北京: 机械工业出版社, 2003: 12-13
[14] Kit Edward. Software testing in the real world: improving process[M]. Pearson Education Limited,2003:36-38
[15] Myers G.J. The Art of Software Testing. New York: John Wiley and Sons,1979:53-56
[16] Gelperin D., Hetzel B. The Growth of Software Testing. CACM 1998; 31:687-695
[17] 飞思科技产品研发中心编著.实用软件测试方法与应用[M]. 北京: 电子工业出版社, 2003:28-31
[18] Linz T., Daigl M.GUI Testing Made Painless. Implementation and Results of the ESSI Project NO.24306,1998:55-62
[19] Myers Glenford J. 计算机软件测试技巧[M]. 北京: 清华大学出版社, 1985:47-55
[20] Few Ster M.,Graham D. 舒智勇等译. 软件测试自动化技术与实例详解[M]. 北京: 电子工业出版社, 2000: 76-78
[21] 韩丽娜. 黑盒测试及测试工具Rationnal Robot的应用[J]. 计算机工程与设计, 2006, 27(2): 359-360
[22] 包晓露, 于秀山. 软件测试自动化技术的研究与实践[J]. 军队指挥自动化, 2002, 4: 21-22
[23] Boujarwah A S, Salch K. Compiler Test Case Generation Methods: A Survey and Assessment.Information and Software Technology, I997, (39): 617-625
[24] Pauon R. 软件测试[M].北京: 机械工业出版社, 2002: 46-47
[25] 张丽波. 软件自动化测试的设计与实施[J]. 佳木斯大学学报(自然科学版),2004, 22(4): 568-572
[26] 黄陇, 于洪敏, 陈致明, 于秀山. 基于 UML 的软件测试自动化研究[J]. 计算机应用, 2004, 24(7): 57-59
[27] 严少清, 陈革, 万年红. 软件测试自动化管理系统的设计与实现[J]. 计算机工程, 2002, 28(9): 152-154
[28] Memon A M, Pollack M E, Soffa M L. Hierarchical GUI Test Case Generation UsingAutomated Planning. IEEE Transactions on Software Engineering, 2001, 27(2): 144-155
[29] 潘静, 陈锡鹏, 王莹.单体自动化测试的实现[J].科技和产业, 2005,5(11):32-34
[30] 张茂林.软件自动测试的研究与程序实现[J].北京航空航天大学学报, 1997, 23(1): 3
[31] 姚砺, 束永安. 软件测试自动化关键技术的研究[J]. 安徽大学学报(自然科学版), 2003, 27(4): 27-33
[32] Hancock James. When to automate testing a cost-benefit analysis [EB/OL],2002:79-81
[33] 张克东, 庄燕滨. 软件工程与软件测试自动化教程[M]. 北京: 电子工业出版社, 2002.: 15-16
[34] Kim YK, Hong HS, Bae DH . Test Cases Generation From UML State Diagrams[J].IEEE Proc.Softw., 1999, 146(4):122-126
[35] 姚实颖. 软件测试自动化中建立可维护脚本的技术[J]. 计算机工程, 2003, 29(11): 79-81
[36] 崔丽. 软件测试自动化框架[J]. 电子与电脑, 2006, 6: 107-111
[37] 金大海, 宫云战. 数据驱动自动化测试方法研究[J].装甲兵工程学院学报, 2004, 18(2): 95-97
[38] 冯玉才, 唐艳, 周淳. 关键字驱动自动化测试的原理和实现[J]. 计算机应用, 2004, 24(8): 56-58
[39] 宋波, 张忠能. 基于系统功能测试的软件自动化测试可行性分析[J]. 计算机应用与软件, 2005, 22(12): 15-17
[40] International Software Automation Inc. Panorama-2 C/C++ User’s Manua1. International Software Automation Inc., 1993:156-167
[41] Csodes T, kotnyek B. Automated test case selection based on sub-purposes. Testing of Communication System Methods and Applications. K1uwer Acadmic publishers, 1999: 251-265
[42] 马雪英, 姚砺, 叶澄清. 回归测试自动化工具研究[J]. 计算机科学, 2005, 32(3): 162-165
[43] 文昌辞, 王昭顺. 软件自动化静态分析研究[J]. 计算机工程与设计, 2005, 26(4): 987-989
[44] 罗圣仪.计算机软件质量保证的方法和实践.北京: 科学出版社 , 1999:89-93
[45] 王莉, 殷锋, 李奇. 软件自动化测试脚本技术研究[J]. 西南民族大学学报(自然科学版), 2006, 32(2): 357-360
[46] 姜卫, 汪厚祥. 图形用户界面的测试自动化[J].舰船电子工程, 2004, 24(3): 50-52
[47] 凌永发, 张云生, 郭秀萍. 软件测试自动化中的脚本技术[J].云南民族学院学报, 2002, 11(1): 544-548
[48] LEVESQUE M, LOUIE J, GUERRERO A M. Test Execution Control Tool: Automating Testing in Spacecraft Integration and Test Environments,IEEE,2000,2:293-298
[49] Hyunsook Do, Sebastian Elbaum, Gregg Rothermel. Infrastructure Support for Controlled Experimentation with Software Testing and Regression Testing Techniques[EB/OL]. UNL|Department of Computer Science and Engineering, 2004:189-192
[2] Mercury Interactive 李康. 如何在企业内部实现软件测试自动化[J]. 计算机应用, 2004, 16(10): 153-155
[3] The Software Engineering Institute, Carnegie Mellon University. Software Test Management: A Key Process Area for Level 2: Repeatable. www.sei.cmu.edu/cmm/ cmm-v2/test-mgt-kpa.htm: “Management Practices”:36-40
[4] Daniel J. Mosley, Bruce A. Posey. Just Enough Software Test Automation. Pearson Education, Inc.,2002:35-37
[5] Humphrey W.S. Managing the Software Process. Prentice Hall PTR, Addison-Wesley, Reading, MA,1989:98-103
[6] Bender, Richard. SEI/CMM Proposed Software Evaluation and Test KPA. Rev. 4, Bender and Associates, P.O.Box 849,Larkspur,CA 94977,April 1996:10-12
[7] Krause, Michael H.A Maturity Model for Automated Software Testing. Medical Device and Diagnostic Industry Magazine, December 1994:57-60
[8] Mosley, Daniel J. Client-Server Software Testing on the Desktop and the Web. Prentice Hall PTR, Upper Saddle River,NJ,1999:42-46
[9] Dustin, Elfriede, Jeff Rashka and John Paul. Automated Software Testing. Addison-Wesley, Reading, MA, 1999:31-35
[10] Power,Mike. Styles for Making Test Automation Work. Addison-Wesley, Reading, MA, 2001:55-61
[11] Stang, Richard. Data Driven Testing for Client/Server Applications. Fifth International Conference on Software Testing, Analysis and Reliability(STAR’96):395-400.
[12] Dustin E,Rashka J,Paul J.于秀山,胡兢玉, 等译.软件自动化测试: 引入、管理与实施[M].北京: 电子工业出版社, 2003:23-25
[13] Paul C. Jorgensen 著, 韩柯 等译. 软件测试(第二版)[M]. 北京: 机械工业出版社, 2003: 12-13
[14] Kit Edward. Software testing in the real world: improving process[M]. Pearson Education Limited,2003:36-38
[15] Myers G.J. The Art of Software Testing. New York: John Wiley and Sons,1979:53-56
[16] Gelperin D., Hetzel B. The Growth of Software Testing. CACM 1998; 31:687-695
[17] 飞思科技产品研发中心编著.实用软件测试方法与应用[M]. 北京: 电子工业出版社, 2003:28-31
[18] Linz T., Daigl M.GUI Testing Made Painless. Implementation and Results of the ESSI Project NO.24306,1998:55-62
[19] Myers Glenford J. 计算机软件测试技巧[M]. 北京: 清华大学出版社, 1985:47-55
[20] Few Ster M.,Graham D. 舒智勇等译. 软件测试自动化技术与实例详解[M]. 北京: 电子工业出版社, 2000: 76-78
[21] 韩丽娜. 黑盒测试及测试工具Rationnal Robot的应用[J]. 计算机工程与设计, 2006, 27(2): 359-360
[22] 包晓露, 于秀山. 软件测试自动化技术的研究与实践[J]. 军队指挥自动化, 2002, 4: 21-22
[23] Boujarwah A S, Salch K. Compiler Test Case Generation Methods: A Survey and Assessment.Information and Software Technology, I997, (39): 617-625
[24] Pauon R. 软件测试[M].北京: 机械工业出版社, 2002: 46-47
[25] 张丽波. 软件自动化测试的设计与实施[J]. 佳木斯大学学报(自然科学版),2004, 22(4): 568-572
[26] 黄陇, 于洪敏, 陈致明, 于秀山. 基于 UML 的软件测试自动化研究[J]. 计算机应用, 2004, 24(7): 57-59
[27] 严少清, 陈革, 万年红. 软件测试自动化管理系统的设计与实现[J]. 计算机工程, 2002, 28(9): 152-154
[28] Memon A M, Pollack M E, Soffa M L. Hierarchical GUI Test Case Generation UsingAutomated Planning. IEEE Transactions on Software Engineering, 2001, 27(2): 144-155
[29] 潘静, 陈锡鹏, 王莹.单体自动化测试的实现[J].科技和产业, 2005,5(11):32-34
[30] 张茂林.软件自动测试的研究与程序实现[J].北京航空航天大学学报, 1997, 23(1): 3
[31] 姚砺, 束永安. 软件测试自动化关键技术的研究[J]. 安徽大学学报(自然科学版), 2003, 27(4): 27-33
[32] Hancock James. When to automate testing a cost-benefit analysis [EB/OL],2002:79-81
[33] 张克东, 庄燕滨. 软件工程与软件测试自动化教程[M]. 北京: 电子工业出版社, 2002.: 15-16
[34] Kim YK, Hong HS, Bae DH . Test Cases Generation From UML State Diagrams[J].IEEE Proc.Softw., 1999, 146(4):122-126
[35] 姚实颖. 软件测试自动化中建立可维护脚本的技术[J]. 计算机工程, 2003, 29(11): 79-81
[36] 崔丽. 软件测试自动化框架[J]. 电子与电脑, 2006, 6: 107-111
[37] 金大海, 宫云战. 数据驱动自动化测试方法研究[J].装甲兵工程学院学报, 2004, 18(2): 95-97
[38] 冯玉才, 唐艳, 周淳. 关键字驱动自动化测试的原理和实现[J]. 计算机应用, 2004, 24(8): 56-58
[39] 宋波, 张忠能. 基于系统功能测试的软件自动化测试可行性分析[J]. 计算机应用与软件, 2005, 22(12): 15-17
[40] International Software Automation Inc. Panorama-2 C/C++ User’s Manua1. International Software Automation Inc., 1993:156-167
[41] Csodes T, kotnyek B. Automated test case selection based on sub-purposes. Testing of Communication System Methods and Applications. K1uwer Acadmic publishers, 1999: 251-265
[42] 马雪英, 姚砺, 叶澄清. 回归测试自动化工具研究[J]. 计算机科学, 2005, 32(3): 162-165
[43] 文昌辞, 王昭顺. 软件自动化静态分析研究[J]. 计算机工程与设计, 2005, 26(4): 987-989
[44] 罗圣仪.计算机软件质量保证的方法和实践.北京: 科学出版社 , 1999:89-93
[45] 王莉, 殷锋, 李奇. 软件自动化测试脚本技术研究[J]. 西南民族大学学报(自然科学版), 2006, 32(2): 357-360
[46] 姜卫, 汪厚祥. 图形用户界面的测试自动化[J].舰船电子工程, 2004, 24(3): 50-52
[47] 凌永发, 张云生, 郭秀萍. 软件测试自动化中的脚本技术[J].云南民族学院学报, 2002, 11(1): 544-548
[48] LEVESQUE M, LOUIE J, GUERRERO A M. Test Execution Control Tool: Automating Testing in Spacecraft Integration and Test Environments,IEEE,2000,2:293-298
[49] Hyunsook Do, Sebastian Elbaum, Gregg Rothermel. Infrastructure Support for Controlled Experimentation with Software Testing and Regression Testing Techniques[EB/OL]. UNL|Department of Computer Science and Engineering, 2004:189-192