规则驱动的自动化测试框架研究与实现
|
摘要
当今的银行交易业务系统规模和复杂性与日俱增,业务的上线要求却越来越严格、急迫,一旦出错将造成不可估量的损失,目前业内普遍情况是采用手工测试,当上线时间急迫时测试质量与测试覆盖率都得不到保证。传统的自动化测试案例的执行和调试成本很高,可能在每次软件变更后,对测试案例需要进行大量的维护以维持其可用性,这类维护工作要求测试人员不但要懂业务,还要懂得程序代码才可以胜任。传统的手工测试、录制与回放技术、甚至包括自动测试工具的引入与使用,依旧不能满足企业对产品测试时间与质量的需求。
本文研究的规则驱动的自动化测试框架技术方法,以银行业务系统测试为背景,采用积累库的概念,使行业经验成为一个可高度重用的财富,并且建立一定的标准,测试的深度与完善度不再受测试者的经验限制,同时考虑第三方测试工具的松散集成。使用该测试框架不要求测试人员掌握高深的计算机编程技术,只要少量的业务专家对系统进行分析,在逐步的测试过程中积累资料、相同的业务不必反复分析,就可进行深入地测试,并且很好的解决了回归测试的问题。目前自动测试框架领域在规则积累方面的研究与开发还处在探索阶段,本文通过对自动化测试框架与银行系统特点的技术研究,提出对特定领域的项目的测试方法,对于最终提高测试效率与测试质量,提高系统的可靠性与可维护性等具有重要意义。
本文研究内容包括以下几点:①建立一套银行交易系统的模拟系统以及特殊硬件的模拟信号,这是这类自动测试系统面向对象框架的基础体系结构。②采用更高层面的测试策略,解决功能测试自动化中的新问题,开辟新的测试思路,使测试的自动化程度更高。③使用基于领域分析的开发方法,开发了一个自动化测试框架来实现自动化测试项目,采用一套逐级生成的机制完成测试设计到测试数据的转换。④框架应用,使用以上提到的测试框架开发一个测试平台,并对该平台的界面与操作进行了展示,使用实际项目的数据做测试,验证了框架的可行性。
Today the banking business system grows more complexity, on the other side the requirement of running business demands more and more stringent and urgent. Once the business system runs errors, it would lead incalculable losses. Manual test is used in most situations. But both the quality and test coverage can not be guaranteed when the running time is not enough. The execution and debugging of traditional automated test cost high, and substantial maintenance work may need everytime after software upgrade. These maintenance work require test professionals. The traditional manual test, record/replay technology, even including the introduce and use of automated testing tools, could not meet the requirement of testing time and quality.
Rules-driven automated test framework use the background of the banking system testing, using the accumulation of the concept of industry experience to become a high degree of reuse of the wealth and establish a certain standards, testing and improvement of the depth of the test are no longer subject to The experience of restrictions, taking into account the third-party testing tools loosely integrated. Use of the test framework does not require testing staff in advanced computer programming, as long as a small business expert analysis of the system, gradually accumulated in the course of the test data, the same business do not have to repeatedly analysis can be conducted in-depth testing, and very good at Regression testing. At present in the field of automatic test framework of rules accumulated research and development is still in the exploratory stage, the paper through the automated test framework of the banking system and the characteristics of the technical studies on specific proposed projects in the field of testing methods.
本文研究的规则驱动的自动化测试框架技术方法,以银行业务系统测试为背景,采用积累库的概念,使行业经验成为一个可高度重用的财富,并且建立一定的标准,测试的深度与完善度不再受测试者的经验限制,同时考虑第三方测试工具的松散集成。使用该测试框架不要求测试人员掌握高深的计算机编程技术,只要少量的业务专家对系统进行分析,在逐步的测试过程中积累资料、相同的业务不必反复分析,就可进行深入地测试,并且很好的解决了回归测试的问题。目前自动测试框架领域在规则积累方面的研究与开发还处在探索阶段,本文通过对自动化测试框架与银行系统特点的技术研究,提出对特定领域的项目的测试方法,对于最终提高测试效率与测试质量,提高系统的可靠性与可维护性等具有重要意义。
本文研究内容包括以下几点:①建立一套银行交易系统的模拟系统以及特殊硬件的模拟信号,这是这类自动测试系统面向对象框架的基础体系结构。②采用更高层面的测试策略,解决功能测试自动化中的新问题,开辟新的测试思路,使测试的自动化程度更高。③使用基于领域分析的开发方法,开发了一个自动化测试框架来实现自动化测试项目,采用一套逐级生成的机制完成测试设计到测试数据的转换。④框架应用,使用以上提到的测试框架开发一个测试平台,并对该平台的界面与操作进行了展示,使用实际项目的数据做测试,验证了框架的可行性。
Today the banking business system grows more complexity, on the other side the requirement of running business demands more and more stringent and urgent. Once the business system runs errors, it would lead incalculable losses. Manual test is used in most situations. But both the quality and test coverage can not be guaranteed when the running time is not enough. The execution and debugging of traditional automated test cost high, and substantial maintenance work may need everytime after software upgrade. These maintenance work require test professionals. The traditional manual test, record/replay technology, even including the introduce and use of automated testing tools, could not meet the requirement of testing time and quality.
Rules-driven automated test framework use the background of the banking system testing, using the accumulation of the concept of industry experience to become a high degree of reuse of the wealth and establish a certain standards, testing and improvement of the depth of the test are no longer subject to The experience of restrictions, taking into account the third-party testing tools loosely integrated. Use of the test framework does not require testing staff in advanced computer programming, as long as a small business expert analysis of the system, gradually accumulated in the course of the test data, the same business do not have to repeatedly analysis can be conducted in-depth testing, and very good at Regression testing. At present in the field of automatic test framework of rules accumulated research and development is still in the exploratory stage, the paper through the automated test framework of the banking system and the characteristics of the technical studies on specific proposed projects in the field of testing methods.
引文
[1]ANSI/IEEE Standard for Software Verification and Validation Plans.ANSI/IEEE Std.
[2]李幸超.实用软件测试[M].北京:电子工业出版社,2006.
[3]http://www.51testing.com/.实施自动化功能测试的解决方案[J].
[4]Elfriede Dustin,Jeff Rashka,John Paul.软件自动化测试:引入、管理与实施[M].电子工业出版社.2003.
[5]Wilson.D.A.Wilson S.D.Writing Frameworks-Capturing Your Expertise about a Problem Domain,Tutorial notes,8th Conference on Object-Oriented Programming Systems,Languages and Applications,Washington,USA,1993.
[6]霍印鹏.WinRunner使用说明书[M].http://www.mercury.com/cn.
[7]2004 Mercury Interactive Corporation,QTP8.2中文版 Tutorial[M].
[8]2004 Mercury Interactive Corporation,Automating Quick Test Operations[M].
[9]Daniel J.Mosley著.邓波等泽.软件测试自动化[M].北京:机械工业出版社,2003.10.
[10]Mattsson..M.Object-Oriented Frameworks — A survey of methodological issues.Licentiate Thesis,Department of Computer Science,Lund University,CODEN:LULEDX/(TECS-3066)/1 — 1301(1996),also as Technical Report,LU-CS-TR:96-167,Department of Computer Science,Lund University,128pp.,1996.
[11]Taligent Inc.J.Leveraging Object-Oriented Frameworks.Http://www.taligent.com/Technology/WhitePapers/LeveragingFwks/LeveragingFrameworks.html,A Taligent White Paper,1993.
[12]Marcus.J.Eduardo Markiewicz,Carlos J.P.de Lueena,Object Oriented Framework Development.ACM Crossroads Student Magazine,2002-7.4..
[13]杨芙消.梅宏.网构软件:未来的新型软件形态[J].中国教育网络.2005,7
[14]刘瑜.张世琨.王立福.杨芙清.基于构件的软件框架与角色扩展形态研究[J].软件学报.2003 Vol.14.No.8
[15]杨芙清.梅宏.李克勤.软件复用及相关技术[J].电子学报,1999年2月.
[16]刘瑜.张世琨.王立福.杨芙清.基于构件的软件框架与角色扩展形态研究[J].2003.
[17]李勤.莫世锋.基于领域框架的软件复用方法与技术[J].情报杂志,No.9,2005
[18]Paul Clements.Linda M.Northrop.A Framework for Software Product Line Practice Version 2.0,1999.
[19]Fayad M.,Schmidt D.Object_oriented Application Frameworks.The Communications of ACM,1997;40(10).
[20]Buschmann M.Meumier R.Rohnert H.Sommerlad P.Stal M.Pattern-Oriented Software Architecture——A System of Patterns.Chichester:John Wiley & Sons Ltd,1996.
[21]C.Rankin.J."the software testing automation framework".IBM SYSTEMS.JOURNAL.VOL 41.NOl.2002.
[22]许小良.自动测试系统的面向对象框架开发方法研究[D].浙江大学.
[23]Nemirovsky,Adolfo M.,Building Object-Oriented Frameworks,http://www-106.ibm.com/devel operworks/java/library/j-oobuilding/?dwzone=Java,Decemb er,1997.
[24]Weinand,M.,Gamma,E.,ET++-a Portcable,Homogenous Class Library and Application Framework,Computer Science Research at UBILAB,Strategy and Projects;Proceedings of the UBILAB '94 Conference,Zurich,September 1994.
[25]TAME M.Cooper.The Design Patterns—Java Companion.Addison-Wesley,1998.
[26]Gamma,E.,Helm,R.,Johnson,R.,Vlissides,J.,Design Patterns:Abstraction and Reuse of Object-Oriented Design,Proceedings of ECOOP'93,pp.406-431,[ECOOP93].
[27]Carl J.Nagle,"Test Automation Frameworks",http://safsdev.sourceforge.net/FRAMESDataDrivenTestAutomationFrameworks.htm.
[28]Daniel J.Mosley,Bruce A.Posey,“软件测试自动化”,邓波黄丽娟曹青春等译,北京,机械工业出版社,2003,P93-131.
[29]崔丽.软件测试自动化框架[D].东南大学软件学院
[30]曾北溟.自动化测试框架的研究与实现[D].武汉大学
[31]http://staf.sourceforge.net/index.php.
[32]崔俊涛.利用STAF实现程序更新包的自动部署测试[J].IBM上海全球实验室的软件工程师.
[33]Linda Hayes.[J].Chief Technology Officer.Worksoft.Inc.Test Frameworks:The Next Level of Automation.
[34]http://www.softwareqatest.com/.
[35]http://safsdev.sourceforge.net/Default.htm
[36]Carl J.Nagle.Test Automation Frameworks whitepaper,http://safsdev.sourceforge.net/.FRAMESDataDrivenTestAutomationFrameworks.htm
[37]http://safsdev.sourceforge.net/Default.htm
[38]Daniel Gouveia.[J].销售工程师.IBM.使用Rational Functional Tester和开源的SAFS解决方案进行关键字驱动测试.
[39]http://www.51testing.com/?action_viewnews_itemid-67352.html.软件自动化测试框架模型SAFS简介[J].
[40]沈雪芳.测试工作量统计新方法[J].计算机世界报.2006年02月27日第07期B25、B26
[41]王世俊.软件自动化测试框架的研究和实现[D].华东师范大学.
[42]Hibernate 第3版开发手册[M].
[43]Hibernate Reference Documentation[M].
[44]孙卫琴.精通Struts:基于MVC的Java Web设计与开发[M].北京:电子工业出版社,2004.
[45]Ted Husted.M.Cedric Dumoulin.George Franciscus.David Winterfeidt.Struts In Action.
[2]李幸超.实用软件测试[M].北京:电子工业出版社,2006.
[3]http://www.51testing.com/.实施自动化功能测试的解决方案[J].
[4]Elfriede Dustin,Jeff Rashka,John Paul.软件自动化测试:引入、管理与实施[M].电子工业出版社.2003.
[5]Wilson.D.A.Wilson S.D.Writing Frameworks-Capturing Your Expertise about a Problem Domain,Tutorial notes,8th Conference on Object-Oriented Programming Systems,Languages and Applications,Washington,USA,1993.
[6]霍印鹏.WinRunner使用说明书[M].http://www.mercury.com/cn.
[7]2004 Mercury Interactive Corporation,QTP8.2中文版 Tutorial[M].
[8]2004 Mercury Interactive Corporation,Automating Quick Test Operations[M].
[9]Daniel J.Mosley著.邓波等泽.软件测试自动化[M].北京:机械工业出版社,2003.10.
[10]Mattsson..M.Object-Oriented Frameworks — A survey of methodological issues.Licentiate Thesis,Department of Computer Science,Lund University,CODEN:LULEDX/(TECS-3066)/1 — 1301(1996),also as Technical Report,LU-CS-TR:96-167,Department of Computer Science,Lund University,128pp.,1996.
[11]Taligent Inc.J.Leveraging Object-Oriented Frameworks.Http://www.taligent.com/Technology/WhitePapers/LeveragingFwks/LeveragingFrameworks.html,A Taligent White Paper,1993.
[12]Marcus.J.Eduardo Markiewicz,Carlos J.P.de Lueena,Object Oriented Framework Development.ACM Crossroads Student Magazine,2002-7.4..
[13]杨芙消.梅宏.网构软件:未来的新型软件形态[J].中国教育网络.2005,7
[14]刘瑜.张世琨.王立福.杨芙清.基于构件的软件框架与角色扩展形态研究[J].软件学报.2003 Vol.14.No.8
[15]杨芙清.梅宏.李克勤.软件复用及相关技术[J].电子学报,1999年2月.
[16]刘瑜.张世琨.王立福.杨芙清.基于构件的软件框架与角色扩展形态研究[J].2003.
[17]李勤.莫世锋.基于领域框架的软件复用方法与技术[J].情报杂志,No.9,2005
[18]Paul Clements.Linda M.Northrop.A Framework for Software Product Line Practice Version 2.0,1999.
[19]Fayad M.,Schmidt D.Object_oriented Application Frameworks.The Communications of ACM,1997;40(10).
[20]Buschmann M.Meumier R.Rohnert H.Sommerlad P.Stal M.Pattern-Oriented Software Architecture——A System of Patterns.Chichester:John Wiley & Sons Ltd,1996.
[21]C.Rankin.J."the software testing automation framework".IBM SYSTEMS.JOURNAL.VOL 41.NOl.2002.
[22]许小良.自动测试系统的面向对象框架开发方法研究[D].浙江大学.
[23]Nemirovsky,Adolfo M.,Building Object-Oriented Frameworks,http://www-106.ibm.com/devel operworks/java/library/j-oobuilding/?dwzone=Java,Decemb er,1997.
[24]Weinand,M.,Gamma,E.,ET++-a Portcable,Homogenous Class Library and Application Framework,Computer Science Research at UBILAB,Strategy and Projects;Proceedings of the UBILAB '94 Conference,Zurich,September 1994.
[25]TAME M.Cooper.The Design Patterns—Java Companion.Addison-Wesley,1998.
[26]Gamma,E.,Helm,R.,Johnson,R.,Vlissides,J.,Design Patterns:Abstraction and Reuse of Object-Oriented Design,Proceedings of ECOOP'93,pp.406-431,[ECOOP93].
[27]Carl J.Nagle,"Test Automation Frameworks",http://safsdev.sourceforge.net/FRAMESDataDrivenTestAutomationFrameworks.htm.
[28]Daniel J.Mosley,Bruce A.Posey,“软件测试自动化”,邓波黄丽娟曹青春等译,北京,机械工业出版社,2003,P93-131.
[29]崔丽.软件测试自动化框架[D].东南大学软件学院
[30]曾北溟.自动化测试框架的研究与实现[D].武汉大学
[31]http://staf.sourceforge.net/index.php.
[32]崔俊涛.利用STAF实现程序更新包的自动部署测试[J].IBM上海全球实验室的软件工程师.
[33]Linda Hayes.[J].Chief Technology Officer.Worksoft.Inc.Test Frameworks:The Next Level of Automation.
[34]http://www.softwareqatest.com/.
[35]http://safsdev.sourceforge.net/Default.htm
[36]Carl J.Nagle.Test Automation Frameworks whitepaper,http://safsdev.sourceforge.net/.FRAMESDataDrivenTestAutomationFrameworks.htm
[37]http://safsdev.sourceforge.net/Default.htm
[38]Daniel Gouveia.[J].销售工程师.IBM.使用Rational Functional Tester和开源的SAFS解决方案进行关键字驱动测试.
[39]http://www.51testing.com/?action_viewnews_itemid-67352.html.软件自动化测试框架模型SAFS简介[J].
[40]沈雪芳.测试工作量统计新方法[J].计算机世界报.2006年02月27日第07期B25、B26
[41]王世俊.软件自动化测试框架的研究和实现[D].华东师范大学.
[42]Hibernate 第3版开发手册[M].
[43]Hibernate Reference Documentation[M].
[44]孙卫琴.精通Struts:基于MVC的Java Web设计与开发[M].北京:电子工业出版社,2004.
[45]Ted Husted.M.Cedric Dumoulin.George Franciscus.David Winterfeidt.Struts In Action.