电子海图系统的GUI软件功能测试技术研究
|
摘要
GUI(图形化用户界面)已经成为用户与软件系统交互必不可少的方式,但是随着软件系统规模的扩大,越来越复杂的GUI增加了软件测试的难度,采用传统的测试方法已经不能保证GUI软件功能测试的质量和效率,如何对GUI软件进行有效的测试已经成为当今软件测试界的一大热点。
本实验室研制的电子海图系统也面临着同样的问题。本文以GUI软件功能测试的测试流程为主线,研究了测试各阶段所需要的技术,并将改进的GUI软件功能测试方法应用在电子海图系统的功能测试中,达到了提高系统功能测试质量和效率的目的。
首先,完成对GUI软件功能测试的理论研究。一方面,以事件流图和综合树图为依据,对GUI建模方法进行深入分析和细化改进,提出事件交互图树模型,并设计出针对该模型的测试覆盖准则和测试用例生成方法。另一方面,为了提高GUI软件测试的自动化程度,深入研究了自动化测试技术和测试脚本开发技术。其次,设计GUI软件功能测试方案,完成对电子海图系统功能测试的实施工作。通过对电子海图系统进行详细的系统功能需求分析,提取出系统的组件结构信息和GUI事件交互信息,建立了电子海图系统的事件交互图树模型;然后据此设计测试用例、测试脚本库和测试数据表;最后利用测试工具实现了电子海图系统的自动化功能测试。
在对电子海图系统功能测试的测试结果进行了分析和讨论后可知,本文提出的电子海图系统的GUI软件功能测试方案可以增加系统功能测试的全面性,提高测试工作的效率和质量,并最终达到提高系统可靠性的目的。
Graphical User Interface (GUI) has been an important and accepted way of interacting with today's software. With the growing scale of the software, the GUI becomes much more complex, and GUI testing becomes more complex, too. Since the traditional software testing methods can not assure the quality and efficiency of GUI testing, how to test GUI effectively turns to a key point in the field of software testing.
The problem has also appeared in the testing process of the Electronic Chart Display and Information System (ECDIS for short), which was developed by our Lab. After learning the testing technologies, an improved method is applied in the GUI testing of the ECDIS.
With a deep research of the technology of modeling, we propose a new GUImodel--the hierarchy model of Event Interactive Graph, which is derived from
Event Flow Graph and Integrated Tree, and design a coverage criterion and a method of generating GUI test cases according to the model. Also, the technology of automated software testing and test-script is studied to execute the test automatically. Then, a GUI functional testing plan is built for the ECDIS. According to the requirements analysis of the system, we build the GUI model for the ECDIS and generate test cases and test data by suitable means. With the help of two testing tools, the automated GUI functional testing to the ECDIS is realized finally.
The results of testing indicate that the new testing technique can raise the coverage of the test and improve the reliability of the system evidently.
本实验室研制的电子海图系统也面临着同样的问题。本文以GUI软件功能测试的测试流程为主线,研究了测试各阶段所需要的技术,并将改进的GUI软件功能测试方法应用在电子海图系统的功能测试中,达到了提高系统功能测试质量和效率的目的。
首先,完成对GUI软件功能测试的理论研究。一方面,以事件流图和综合树图为依据,对GUI建模方法进行深入分析和细化改进,提出事件交互图树模型,并设计出针对该模型的测试覆盖准则和测试用例生成方法。另一方面,为了提高GUI软件测试的自动化程度,深入研究了自动化测试技术和测试脚本开发技术。其次,设计GUI软件功能测试方案,完成对电子海图系统功能测试的实施工作。通过对电子海图系统进行详细的系统功能需求分析,提取出系统的组件结构信息和GUI事件交互信息,建立了电子海图系统的事件交互图树模型;然后据此设计测试用例、测试脚本库和测试数据表;最后利用测试工具实现了电子海图系统的自动化功能测试。
在对电子海图系统功能测试的测试结果进行了分析和讨论后可知,本文提出的电子海图系统的GUI软件功能测试方案可以增加系统功能测试的全面性,提高测试工作的效率和质量,并最终达到提高系统可靠性的目的。
Graphical User Interface (GUI) has been an important and accepted way of interacting with today's software. With the growing scale of the software, the GUI becomes much more complex, and GUI testing becomes more complex, too. Since the traditional software testing methods can not assure the quality and efficiency of GUI testing, how to test GUI effectively turns to a key point in the field of software testing.
The problem has also appeared in the testing process of the Electronic Chart Display and Information System (ECDIS for short), which was developed by our Lab. After learning the testing technologies, an improved method is applied in the GUI testing of the ECDIS.
With a deep research of the technology of modeling, we propose a new GUImodel--the hierarchy model of Event Interactive Graph, which is derived from
Event Flow Graph and Integrated Tree, and design a coverage criterion and a method of generating GUI test cases according to the model. Also, the technology of automated software testing and test-script is studied to execute the test automatically. Then, a GUI functional testing plan is built for the ECDIS. According to the requirements analysis of the system, we build the GUI model for the ECDIS and generate test cases and test data by suitable means. With the help of two testing tools, the automated GUI functional testing to the ECDIS is realized finally.
The results of testing indicate that the new testing technique can raise the coverage of the test and improve the reliability of the system evidently.
引文
[1]Myers B A.User interface software tools.ACM Transactions on Computer-Human Interaction.1995,2(1):64-103P
[2]Atif M.Memon,Martha E.Pollack,Mary Lou Soffa.Coverage Criteria for GUI Testing.ACM SIGSOFT Software Engineering Notes.2001,26(5):256-267P
[3]Atif M.Memon,Martha E.Pollack,Mary Lou Soffa.Using a Goal-driven Approach to Generate Test Cases for GUIs.Proc.21st Int'l Conf.Software Eng.1999,5:257-266P
[4]Atif M.Memon,Martha E.Pollack,Mary Lou Soffa.Hierarchical GUI Test Case Generation Using Automated Planning.IEEE transactions on software engineering.Feb.2001,27(2):144-155P
[5]White L.Regression testing of GUI event interaetions.In:Proeeedings of the International Conference on Software Maintenance.ICSM'96.IEEE Computer Society,Washington,DC.1996:350-358P
[6]White L,Almezen H,Sastry S.Firewall Regression Testing of GUI Sequences and Their Interactions[C].Proc of the International Conf on Software Maintenance,IEEE Press,New York,2003:398-409P
[7]Shehaby R,Siewiorek D.A method to automate user interface testing using variable finite state machines.In:Proeeedings of the 27th International Symposium on Fault-Tolerant Computing.FTCS'97.Washington,DC.IEEE Computer Society,1997:80-88P
[8]刘超.程序交互执行流程图及其测试覆盖准则.软件学报,1998,9(6):458-463页
[9]顾玉良,王立福.界面类对象建模技术研究.计算机工程,1999,25(7):21-23页
[10]何允如,刘宗阳,郝峰.基于程序执行状态图的软件测试方法研究.计算机工程与应用.2002,38(18):96-98页
[11]杜栓柱,谭建荣,陆国栋.基于界面构件关联图的软件功能测试技术.计算机研究与发展.2002,39(2):148-152页
[12]陈启安,李小将,李蜀瑜.一种VFSM的图形用户界面的测试方法.厦门大学学报(自然科学版),2002,41(6):705-710页
[13]张涌,钱乐秋,王渊峰.基于扩展有限状态机测试中测试输入数据自动选取的研究.计算机学报,2003,26(10):129-130页
[14]杨凡德,李小将,闫舒.GUI自动测试工具设计与实现.装备指挥技术学院学报,2003,14(3):77-80页
[15]胡积平.基于权重事件的GUI测试研究.湖南大学硕士学位论文.2006:13-27页
[16]柳纯录,黄子河,陈禄萍.软件评测师教程.北京:清华大学出版社,2005:6-68页
[17]Glenford J.Myers,Revised and updated by Tom Badgett and Todd Thomas with Corey Sandler.The art of software testing(2nd ed).John Wiley & Sons,Inc.,Hoboken,New Jersey Canada,2004:4-10P
[18]佟伟光.软件测试.北京:人民邮电出版社,2008,5:16-35页
[19]Bill Hetzel.The Complete Guide to Software Testing,2nd ed.QED Information Sciences,Inc.Wellesley,MA,USA,1988:20-56P
[20]赵斌.软件测试技术经典教程.北京:科学出版社,2007,5:15-20页
[21]Atif M.Memon,Martha E.Pollack,Mary Lou Sofia.Automated test oracles for GUIs.In:Proeeedings of the 8th ACM SIGSOFT International SymPosium on Foundations of Software Engineering:Twenty-first Century APPlications.SIGSOFT'00/FSE-8.New York:ACM Press,2000:30-39P.
[22]B.A.Myers.User interface software technology.ACM Comput.Surv.1996,28(1):189-191P
[23]Atif M.Memon.GUI testing:Pitfalls and Process.Computer.2002,35(8):87-88P
[24]徐宝文,周毓明,卢红敏.UML与软件建模.北京:清华大学出版社,2006:15-16页
[25]Robert V.Binder,华庆一等译.面向对象系统的测试.北京:人民邮电 出版社,2001:20-40页
[26]王立峰.基于模型的GUI测试工具的实现研究.南京航空航天大学硕士学位论文.2007:17-27页
[27]Atif Memon,Ishan Banerjee,Adithya Nagarajan.What Test Oracle Should I Use for Effective GUI Testing? In:Proceedings of the 18th IEEE International Conference on Automated Software Engineering(ASE'03),2003:167-173P
[28]郭冬卿.基于事件流图的GUI测试.大连理工大学硕士学位论文,2006:24-48页
[29]A.M.Memon.Advances in GUI testing.In Advances in Computers,ed.by Marvin V.Zelkowitz,Academic Press,2003:149-201P
[30]Atif Memon,Ishan Banerjee,Nada Hashmi.DART:A Framework for Regression Testing "Nightly/daily Builds" of GUI Applications.Proceedings of the International Conference on Software Maintenance (ICSM'03),2003:410-419P
[31]A.M.Memon,M.E.Pollack,M.L.Soffa.Automated test oracles for GUIs.In Proceedings of the ACM SIGSOFT 8th International Symposium on the Foundations of Software Engineering(FSE-8),NY,2000:30-39P
[32]Qing Xie,Atif M Memon.Studying the Characteristics of a_Good_GUI Test Suite.17th International Symposium on Software Reliability Engineering(ISSRE'06),2006:159-168P
[33]Woei-Kae Chen,Tung-Hung Tsai,Hung-Hsing Chao.Integration of specification-based and CR-based approaches for GUI testing.Proceedings of the 19th International Conference on Advanced Information Networking and Applications(AINA'05),2005:164-173P
[34]Kevin M.Conroy,Mark Grechanik,Matthew Hellige.Automatic Test Generation From GUI Applications For Testing Web Services.Software Maintenance,ICSM 2007,2007:345-354P
[35]Elfriede Dustin,Jeff Rashka,John Paul.Automated Software Testing Introduction,Management,and Performance.Pearson Education,Inc., publishing as Addison Wesley.1999:37-56P
[36]Mark Fewster,Dorothy Graham,黍智勇,包晓露,焦跃译.Software Test Automation,软件测试自动化技术与实例详解.北京:电子工业出版社,2000:10-16页
[37]Qing Xie,Atif M.Memon.Rapid "Crash Testing" for Continuously Evolving GUI-Based Software Applications.In Proceedings of The International Conference on Software Maintenance 2005(ICSM'05),Budapest,Hungary,2005.9:476-482P
[38]L.White,H.AlMezen,and N.Alzeidi.User-based testing of GUI sequences and their interactions.In Proceedings of the 12th International Symposium Software Reliability Engineering,2001:54-63P
[39]A.M.Memon,M.L.Soffa,M.E.Pollack.Coverage criteria for GUI testing.In Proceedings of the 8th European Software Engineering Conference(ESEC) and 9th ACM SIGSOFT International Symposium on the Foundations of Software Engineering(FSE-9),Sept.2001:256-267P
[40]Kanglin Li,Mengqi Wu.Effective GUI Test Automation.SYBEX Inc.,1151Marina Village Parkway,Alameda,CA 94501,2004:3-19P
[41]张年林.面向GUI软件测试的自动化工具研究与实现.西安理工大学硕士学位论文,2007:19-21页
[42]A.M.Memon,M.L.Soffa.Regression testing of GUIs.In Proceedings of the 9th European Software Engineering Conference(ESEC) and 11th ACM SIGSOFT International Symposium on the Foundations of Software Engineering(FSE-11),Sept.2003:118-127P
[43]A.Memon,A.Nagarajan,Q.Xie.Automating regression testing for evolving GUI software.Journal of Software Maintenance and Evolution:Research and Practice,2005,17(1):27-64P
[2]Atif M.Memon,Martha E.Pollack,Mary Lou Soffa.Coverage Criteria for GUI Testing.ACM SIGSOFT Software Engineering Notes.2001,26(5):256-267P
[3]Atif M.Memon,Martha E.Pollack,Mary Lou Soffa.Using a Goal-driven Approach to Generate Test Cases for GUIs.Proc.21st Int'l Conf.Software Eng.1999,5:257-266P
[4]Atif M.Memon,Martha E.Pollack,Mary Lou Soffa.Hierarchical GUI Test Case Generation Using Automated Planning.IEEE transactions on software engineering.Feb.2001,27(2):144-155P
[5]White L.Regression testing of GUI event interaetions.In:Proeeedings of the International Conference on Software Maintenance.ICSM'96.IEEE Computer Society,Washington,DC.1996:350-358P
[6]White L,Almezen H,Sastry S.Firewall Regression Testing of GUI Sequences and Their Interactions[C].Proc of the International Conf on Software Maintenance,IEEE Press,New York,2003:398-409P
[7]Shehaby R,Siewiorek D.A method to automate user interface testing using variable finite state machines.In:Proeeedings of the 27th International Symposium on Fault-Tolerant Computing.FTCS'97.Washington,DC.IEEE Computer Society,1997:80-88P
[8]刘超.程序交互执行流程图及其测试覆盖准则.软件学报,1998,9(6):458-463页
[9]顾玉良,王立福.界面类对象建模技术研究.计算机工程,1999,25(7):21-23页
[10]何允如,刘宗阳,郝峰.基于程序执行状态图的软件测试方法研究.计算机工程与应用.2002,38(18):96-98页
[11]杜栓柱,谭建荣,陆国栋.基于界面构件关联图的软件功能测试技术.计算机研究与发展.2002,39(2):148-152页
[12]陈启安,李小将,李蜀瑜.一种VFSM的图形用户界面的测试方法.厦门大学学报(自然科学版),2002,41(6):705-710页
[13]张涌,钱乐秋,王渊峰.基于扩展有限状态机测试中测试输入数据自动选取的研究.计算机学报,2003,26(10):129-130页
[14]杨凡德,李小将,闫舒.GUI自动测试工具设计与实现.装备指挥技术学院学报,2003,14(3):77-80页
[15]胡积平.基于权重事件的GUI测试研究.湖南大学硕士学位论文.2006:13-27页
[16]柳纯录,黄子河,陈禄萍.软件评测师教程.北京:清华大学出版社,2005:6-68页
[17]Glenford J.Myers,Revised and updated by Tom Badgett and Todd Thomas with Corey Sandler.The art of software testing(2nd ed).John Wiley & Sons,Inc.,Hoboken,New Jersey Canada,2004:4-10P
[18]佟伟光.软件测试.北京:人民邮电出版社,2008,5:16-35页
[19]Bill Hetzel.The Complete Guide to Software Testing,2nd ed.QED Information Sciences,Inc.Wellesley,MA,USA,1988:20-56P
[20]赵斌.软件测试技术经典教程.北京:科学出版社,2007,5:15-20页
[21]Atif M.Memon,Martha E.Pollack,Mary Lou Sofia.Automated test oracles for GUIs.In:Proeeedings of the 8th ACM SIGSOFT International SymPosium on Foundations of Software Engineering:Twenty-first Century APPlications.SIGSOFT'00/FSE-8.New York:ACM Press,2000:30-39P.
[22]B.A.Myers.User interface software technology.ACM Comput.Surv.1996,28(1):189-191P
[23]Atif M.Memon.GUI testing:Pitfalls and Process.Computer.2002,35(8):87-88P
[24]徐宝文,周毓明,卢红敏.UML与软件建模.北京:清华大学出版社,2006:15-16页
[25]Robert V.Binder,华庆一等译.面向对象系统的测试.北京:人民邮电 出版社,2001:20-40页
[26]王立峰.基于模型的GUI测试工具的实现研究.南京航空航天大学硕士学位论文.2007:17-27页
[27]Atif Memon,Ishan Banerjee,Adithya Nagarajan.What Test Oracle Should I Use for Effective GUI Testing? In:Proceedings of the 18th IEEE International Conference on Automated Software Engineering(ASE'03),2003:167-173P
[28]郭冬卿.基于事件流图的GUI测试.大连理工大学硕士学位论文,2006:24-48页
[29]A.M.Memon.Advances in GUI testing.In Advances in Computers,ed.by Marvin V.Zelkowitz,Academic Press,2003:149-201P
[30]Atif Memon,Ishan Banerjee,Nada Hashmi.DART:A Framework for Regression Testing "Nightly/daily Builds" of GUI Applications.Proceedings of the International Conference on Software Maintenance (ICSM'03),2003:410-419P
[31]A.M.Memon,M.E.Pollack,M.L.Soffa.Automated test oracles for GUIs.In Proceedings of the ACM SIGSOFT 8th International Symposium on the Foundations of Software Engineering(FSE-8),NY,2000:30-39P
[32]Qing Xie,Atif M Memon.Studying the Characteristics of a_Good_GUI Test Suite.17th International Symposium on Software Reliability Engineering(ISSRE'06),2006:159-168P
[33]Woei-Kae Chen,Tung-Hung Tsai,Hung-Hsing Chao.Integration of specification-based and CR-based approaches for GUI testing.Proceedings of the 19th International Conference on Advanced Information Networking and Applications(AINA'05),2005:164-173P
[34]Kevin M.Conroy,Mark Grechanik,Matthew Hellige.Automatic Test Generation From GUI Applications For Testing Web Services.Software Maintenance,ICSM 2007,2007:345-354P
[35]Elfriede Dustin,Jeff Rashka,John Paul.Automated Software Testing Introduction,Management,and Performance.Pearson Education,Inc., publishing as Addison Wesley.1999:37-56P
[36]Mark Fewster,Dorothy Graham,黍智勇,包晓露,焦跃译.Software Test Automation,软件测试自动化技术与实例详解.北京:电子工业出版社,2000:10-16页
[37]Qing Xie,Atif M.Memon.Rapid "Crash Testing" for Continuously Evolving GUI-Based Software Applications.In Proceedings of The International Conference on Software Maintenance 2005(ICSM'05),Budapest,Hungary,2005.9:476-482P
[38]L.White,H.AlMezen,and N.Alzeidi.User-based testing of GUI sequences and their interactions.In Proceedings of the 12th International Symposium Software Reliability Engineering,2001:54-63P
[39]A.M.Memon,M.L.Soffa,M.E.Pollack.Coverage criteria for GUI testing.In Proceedings of the 8th European Software Engineering Conference(ESEC) and 9th ACM SIGSOFT International Symposium on the Foundations of Software Engineering(FSE-9),Sept.2001:256-267P
[40]Kanglin Li,Mengqi Wu.Effective GUI Test Automation.SYBEX Inc.,1151Marina Village Parkway,Alameda,CA 94501,2004:3-19P
[41]张年林.面向GUI软件测试的自动化工具研究与实现.西安理工大学硕士学位论文,2007:19-21页
[42]A.M.Memon,M.L.Soffa.Regression testing of GUIs.In Proceedings of the 9th European Software Engineering Conference(ESEC) and 11th ACM SIGSOFT International Symposium on the Foundations of Software Engineering(FSE-11),Sept.2003:118-127P
[43]A.Memon,A.Nagarajan,Q.Xie.Automating regression testing for evolving GUI software.Journal of Software Maintenance and Evolution:Research and Practice,2005,17(1):27-64P