软件自动化测试系统的研究与实现
|
摘要
随着现代信息技术的飞速发展,软件业竞争的日趋激烈,软件系统日益复杂,对于软件功能、性能的要求不断提高,同时软件推出新版本的时间不断缩短。在这种情况下如何保证软件质量成为企业关注的重点。
仅仅依靠以密集为特征的传统手工测试,已经不能满足快节奏软件开发和测试的需求。自动化测试为此提供了成功解决方案。自动化测试是测试体系中新发展起来的一个分支,实施正确合理的自动化测试能够分担手工测试特别是回归测试的工作量,降低性能测试的难度,从而在保证软件质量的前提下,缩短测试周期,降低软件成本。
本文以嵌入式软件的回归测试自动化作为研究的重点。首先,针对嵌入式回归测试的特点,提出一个分布式回归测试自动化框架模型,该自动测试框架模型具有良好通用性,跨平台性和可扩展性等优点。再次,在分布式自动化测试框架的基础上,设计一个基于有限状态机的自动测试执行引擎,该自动测试执行引擎通过友好的图形用户界面,向用户提供了对工作执行过程的灵活的监控和控制功能。最后,以RG产品的自
With the development of information Science and technology, complexity in today’s computer system is higher than ever, bring about the need for more thorough testing to sustain the tolerable level of reliability.Competition in today’s software industry is tougher than ever, stimulated by the consumers with high expections of functionality and performance growth, as well as continuous faster time to market. How to keep the quality of product under such pressures becomes the key point for these organizations to achieve success.
In order to do more with less, organizations want to test their software better and more often with faster and cheaper. Depending on only manual test, which is featured by labor-intensive, costly and time-consuming, could no longer meet these needs. Automated testing, a rising technique in software testing industry, is the ultimate means to this end. If employed correctely, it could take over a great amount of heavy work from manual testing,eg, in regression test and performace test, hence shorten the software QA lifecycle and cut the cost, without losing high quality of product.
In this paper, our major research content is about automating regression test for embedded software. First, according to the feature of embedded
仅仅依靠以密集为特征的传统手工测试,已经不能满足快节奏软件开发和测试的需求。自动化测试为此提供了成功解决方案。自动化测试是测试体系中新发展起来的一个分支,实施正确合理的自动化测试能够分担手工测试特别是回归测试的工作量,降低性能测试的难度,从而在保证软件质量的前提下,缩短测试周期,降低软件成本。
本文以嵌入式软件的回归测试自动化作为研究的重点。首先,针对嵌入式回归测试的特点,提出一个分布式回归测试自动化框架模型,该自动测试框架模型具有良好通用性,跨平台性和可扩展性等优点。再次,在分布式自动化测试框架的基础上,设计一个基于有限状态机的自动测试执行引擎,该自动测试执行引擎通过友好的图形用户界面,向用户提供了对工作执行过程的灵活的监控和控制功能。最后,以RG产品的自
With the development of information Science and technology, complexity in today’s computer system is higher than ever, bring about the need for more thorough testing to sustain the tolerable level of reliability.Competition in today’s software industry is tougher than ever, stimulated by the consumers with high expections of functionality and performance growth, as well as continuous faster time to market. How to keep the quality of product under such pressures becomes the key point for these organizations to achieve success.
In order to do more with less, organizations want to test their software better and more often with faster and cheaper. Depending on only manual test, which is featured by labor-intensive, costly and time-consuming, could no longer meet these needs. Automated testing, a rising technique in software testing industry, is the ultimate means to this end. If employed correctely, it could take over a great amount of heavy work from manual testing,eg, in regression test and performace test, hence shorten the software QA lifecycle and cut the cost, without losing high quality of product.
In this paper, our major research content is about automating regression test for embedded software. First, according to the feature of embedded
引文
[1] 唐思章,陈涵生. 分布式自动化负载测试系统的设计与实现. 计算机工程,2006.2,32(4).
[2] 马雪英,姚砺,叶澄清. 回归测试自动化工具研究. 计算机科学,2005,32(3).
[3] 高海昌,贺晓红等. 软件结构测试自动化关键技术研究. 微电子学与计算机,2005,22(2).
[4] 朱经纬. XML 技术在软件测试自动化中的应用. 计算机工程,2005.1,31(2).
[5] 李念强,孙传伟,王玉泰. 分布式测试平台的应用研究. 计算机测试与控制,2003,11(12).
[6] 杨冰,许静等. 分布式自动测试系统及其客户端的实现. 南开大学学报(自然科学版),2003.3,36(1).
[7] 王毅,蔡建平. 基于 API 测试的分布式测试框架的研究与实现. 计算机工程与设计,2004.8,25(8).
[8] 罗翠华,古天祥. 基于 Bluetooth 技术的分布式测试系统研究. 仪器仪表学报,2002.6,23(3).
[9] 徐虹. 面向对象的软件测试模型及策略研究. 计算机与现代化,2005.3.
[10] 章亮,刘斌等. 嵌入式软件测试开发环境的框架设计. 北京航空航天大学学报,2005.3,31(3).
[11] 刘鸿,吴建平. 协议分布式测试系统的性能模型. 高技术通讯,2003.8.
[12] 尤永康,刘乃琦. 自动化回归测试在 Java 项目中的实现. 计算机应用,2005.1,25(1).
[13] 蒋涛,张彬等. 分布式网络性能测试系统的设计与实现.计算机应用,2005.1,25(1).
[14] 雍建平等. 基于软件可靠性工程的测试模型. 计算机工程.,2005.9,31(17).
[15] 文昌辞,王昭顺. 软件测试自动化静态分析研究. 计算机工程与设计,2005.4,26(4).
[16] 武秦欣. 自动化测试技术在软件项目中的应用.西安建筑科技大学硕士学位论文,2006.5.
[17] 应杭. 软件自动化测试技术及应用研究. 浙江大学硕士学位论文,2006.3.
[18] 许姝韫. 嵌入式软件自动化测试技术研究. 南京理工大学硕士学位论文,2004.6.
[19] 朱菊. 软件自动化测试框架 TAF 及其应用. 河海大学硕士学位论文,2006.5.
[20] Daniel J. Mosley. 软件测试自动化. 机械工业出版社,2003.10.
[21] Paul C. Jorgensen. 软件测试. 机械工业出版社,2003.7.
[22] Elfriede Dustin, Jeff Rashka. 软件自动化测试:引入、管理与实施. 电子工业出版社,2003.1.
[23] 张克东,庄燕滨. 软件工程与软件测试自动化教程,电子工业出版社,2002.2
[24] http://staf.sourceforge.net/index.php.
[25] Steven Clicker,Frederick Hosch. A Design Approach for a Distributed Test Automation System. IEEE,1990.
[26] Eugenia Diaz,Javier Tuya,Raquel Blanco. A Modular Tool for Automated Coverage in Software Testing. Proceeding of the Eleventh Annual International Workshop on Software Technology and Engineering Practices,2004.
[27] Ghaffari Abu,Joao W. Cangussu. A quantitative Learning Model for software Test Process. Proceeding of the 38th Hawaii International Conference on System Science,2005.
[28] Jonathan M. Roberts,Peter I. Corke,Robin J. Kirkham. A Real-Time Software Architecture for Robotics and Automation. Proceeding of the 1999 IEEE International Conference on Robotics & Automation,1999.5.
[29] Ajay Pandey,Nader Kameli,Abraham Eapen. Application of Tightly Coupled Engineering Team for Development for Test Automation Software—A Real World Experience. Proceeding of the 27th Annual International Computer Software and Application Conference,2003.
[30] SUN Chang-ai,LIU Chao,JIN Mao-zhong. Architecture Framework for Software Test Tool. IEEE,2000.
[31] Ramaswamy Chandramouli , Mark Blackburn. Automated Testing of Security Functions using a combined Model & Interface-driven Approach. Proceeding of the 37th Hawaii International Conference on System Science,2004.
[32] Antawan Holmes,Marc Kellogg. Automating Functional Tests Using Selenium. Proceedings of AGILE 2006 Conference,2006.
[33] Feng Zhu,Sanjai Rayadurgam,Wei-Tek Tsai. Automating Regression Testing for Real-Time Software in a Distributed Enviroment. Proceedings of IEEE Software Maintenance Conference,2005.
[34] H. Agrawal,J.R. Horgan,E.W. Krauser. Incremental Regression Testing. Proceedings of IEEE Software Maintenance Conference,1993.
[35] L. Elliott,R. Mojdehbakhsh and W.T. Tsai. A Process for Developing Safe Software. Proceedings of the 7th Annual IEEE Symposium on Computer-Based Medical System.1994.6.
[36] S. Kirani,W.T.Tsai. Specification and Verification of Object-Oriented Programs. Technical Report,University of Minnesota,1994.
[37] M. Poonawala,S, Subramanian,W.T.Tsai. Testing Safety-Critical System-A Resue-Oriented Approach. International Conference on Software Engineering and Knowledge Engineering,1997.6.
[38] L. J. White,V. Narayanswamy. Test Manager: A Regression Testing Tool. Proceedings of IEEE Software Maintenance Conference,1993.
[39] Kaner, C. Architectures of Test Automation. Software Tesing,Analysis & Review Conference West,San Jose,CA,2000.10.
[40] Atchison, B. M. Safety validation of embedded control software using Z animation. Proc 5th Intitute Symposium on High Assurance Systems Engineer,2000.11.
[41] Auguston,M. A language for debugging automation. Conference onSoftware Engineer & Knowledge Engineering,1994.6.
[42] Auguston,M. Lightweight semantics models for program testing and debugging automation. Modeling Software System Structure in Fastly Moving Scenario. 2000.6
[43] Auguston,M. A framework for automatic debugging. Conference on automatic debugging. Proceeding 17th International Conference on Automated Software Engineer,2002.9.
[44] Harel D. Executable Object modeling with statecharts. Proceeding 18th International Conference on Software Engineering. 1996.3.
[45] Christer Persson,Nur Yilmazturk. Estabishment of Automated Regression Testing at ABB Industrail Experience Report on ‘Avoding the piffalls’. Proceedings of the 19th International Conference on Automated Software Engineer,2004.
[2] 马雪英,姚砺,叶澄清. 回归测试自动化工具研究. 计算机科学,2005,32(3).
[3] 高海昌,贺晓红等. 软件结构测试自动化关键技术研究. 微电子学与计算机,2005,22(2).
[4] 朱经纬. XML 技术在软件测试自动化中的应用. 计算机工程,2005.1,31(2).
[5] 李念强,孙传伟,王玉泰. 分布式测试平台的应用研究. 计算机测试与控制,2003,11(12).
[6] 杨冰,许静等. 分布式自动测试系统及其客户端的实现. 南开大学学报(自然科学版),2003.3,36(1).
[7] 王毅,蔡建平. 基于 API 测试的分布式测试框架的研究与实现. 计算机工程与设计,2004.8,25(8).
[8] 罗翠华,古天祥. 基于 Bluetooth 技术的分布式测试系统研究. 仪器仪表学报,2002.6,23(3).
[9] 徐虹. 面向对象的软件测试模型及策略研究. 计算机与现代化,2005.3.
[10] 章亮,刘斌等. 嵌入式软件测试开发环境的框架设计. 北京航空航天大学学报,2005.3,31(3).
[11] 刘鸿,吴建平. 协议分布式测试系统的性能模型. 高技术通讯,2003.8.
[12] 尤永康,刘乃琦. 自动化回归测试在 Java 项目中的实现. 计算机应用,2005.1,25(1).
[13] 蒋涛,张彬等. 分布式网络性能测试系统的设计与实现.计算机应用,2005.1,25(1).
[14] 雍建平等. 基于软件可靠性工程的测试模型. 计算机工程.,2005.9,31(17).
[15] 文昌辞,王昭顺. 软件测试自动化静态分析研究. 计算机工程与设计,2005.4,26(4).
[16] 武秦欣. 自动化测试技术在软件项目中的应用.西安建筑科技大学硕士学位论文,2006.5.
[17] 应杭. 软件自动化测试技术及应用研究. 浙江大学硕士学位论文,2006.3.
[18] 许姝韫. 嵌入式软件自动化测试技术研究. 南京理工大学硕士学位论文,2004.6.
[19] 朱菊. 软件自动化测试框架 TAF 及其应用. 河海大学硕士学位论文,2006.5.
[20] Daniel J. Mosley. 软件测试自动化. 机械工业出版社,2003.10.
[21] Paul C. Jorgensen. 软件测试. 机械工业出版社,2003.7.
[22] Elfriede Dustin, Jeff Rashka. 软件自动化测试:引入、管理与实施. 电子工业出版社,2003.1.
[23] 张克东,庄燕滨. 软件工程与软件测试自动化教程,电子工业出版社,2002.2
[24] http://staf.sourceforge.net/index.php.
[25] Steven Clicker,Frederick Hosch. A Design Approach for a Distributed Test Automation System. IEEE,1990.
[26] Eugenia Diaz,Javier Tuya,Raquel Blanco. A Modular Tool for Automated Coverage in Software Testing. Proceeding of the Eleventh Annual International Workshop on Software Technology and Engineering Practices,2004.
[27] Ghaffari Abu,Joao W. Cangussu. A quantitative Learning Model for software Test Process. Proceeding of the 38th Hawaii International Conference on System Science,2005.
[28] Jonathan M. Roberts,Peter I. Corke,Robin J. Kirkham. A Real-Time Software Architecture for Robotics and Automation. Proceeding of the 1999 IEEE International Conference on Robotics & Automation,1999.5.
[29] Ajay Pandey,Nader Kameli,Abraham Eapen. Application of Tightly Coupled Engineering Team for Development for Test Automation Software—A Real World Experience. Proceeding of the 27th Annual International Computer Software and Application Conference,2003.
[30] SUN Chang-ai,LIU Chao,JIN Mao-zhong. Architecture Framework for Software Test Tool. IEEE,2000.
[31] Ramaswamy Chandramouli , Mark Blackburn. Automated Testing of Security Functions using a combined Model & Interface-driven Approach. Proceeding of the 37th Hawaii International Conference on System Science,2004.
[32] Antawan Holmes,Marc Kellogg. Automating Functional Tests Using Selenium. Proceedings of AGILE 2006 Conference,2006.
[33] Feng Zhu,Sanjai Rayadurgam,Wei-Tek Tsai. Automating Regression Testing for Real-Time Software in a Distributed Enviroment. Proceedings of IEEE Software Maintenance Conference,2005.
[34] H. Agrawal,J.R. Horgan,E.W. Krauser. Incremental Regression Testing. Proceedings of IEEE Software Maintenance Conference,1993.
[35] L. Elliott,R. Mojdehbakhsh and W.T. Tsai. A Process for Developing Safe Software. Proceedings of the 7th Annual IEEE Symposium on Computer-Based Medical System.1994.6.
[36] S. Kirani,W.T.Tsai. Specification and Verification of Object-Oriented Programs. Technical Report,University of Minnesota,1994.
[37] M. Poonawala,S, Subramanian,W.T.Tsai. Testing Safety-Critical System-A Resue-Oriented Approach. International Conference on Software Engineering and Knowledge Engineering,1997.6.
[38] L. J. White,V. Narayanswamy. Test Manager: A Regression Testing Tool. Proceedings of IEEE Software Maintenance Conference,1993.
[39] Kaner, C. Architectures of Test Automation. Software Tesing,Analysis & Review Conference West,San Jose,CA,2000.10.
[40] Atchison, B. M. Safety validation of embedded control software using Z animation. Proc 5th Intitute Symposium on High Assurance Systems Engineer,2000.11.
[41] Auguston,M. A language for debugging automation. Conference onSoftware Engineer & Knowledge Engineering,1994.6.
[42] Auguston,M. Lightweight semantics models for program testing and debugging automation. Modeling Software System Structure in Fastly Moving Scenario. 2000.6
[43] Auguston,M. A framework for automatic debugging. Conference on automatic debugging. Proceeding 17th International Conference on Automated Software Engineer,2002.9.
[44] Harel D. Executable Object modeling with statecharts. Proceeding 18th International Conference on Software Engineering. 1996.3.
[45] Christer Persson,Nur Yilmazturk. Estabishment of Automated Regression Testing at ABB Industrail Experience Report on ‘Avoding the piffalls’. Proceedings of the 19th International Conference on Automated Software Engineer,2004.