基于组合匹配的成对组合测试数据生成
|
摘要
软件测试是根据软件开发各阶段的规格说明和程序的内部结构而精心设计的一组测试数据,并利用这些测试数据运行程序,以发现程序错误的过程。软件测试的实质是一项逻辑性强、且极具条理的工作,也是具有风险性的行为。软件测试的目的是发现错误,评估测试程度,而不是确认其正确性,它希望能找出软件中潜在的各种错误和缺陷。软件测试的方法和技术是多种多样的,本文主要研究成对组合测试。本文的主要内容归纳如下:
本文首先介绍软件测试的特点、意义及研究现状;然后介绍了一些常见的软件测试的方法,并重点介绍了组合测试;接着介绍了成对测试的基本原理、相关概念和目前的发展趋势,并分析了其优缺点;最后介绍了一种新的成对测试数据生成算法。
在组合测试中的两两组合领域中,本文提出了一种基于扩展循环矩阵的测试数据生成算法,理论分析和模拟实验表明,当输入域及参数域相同且均为质数时,该算法能非常完美的实现成对组合测试数据集的要求;接着,本文在此算法的基础上,充分讨论了当输入域及参数域不同时最小成对测试数据集的生成;最后,本文针对输入域及参数域为合数的情况做了理论分析,得出了当输入域为四的最小成对测试数据集,并对六及六以后的合数做了初步的估计。
本文所提出的基于扩展循环矩阵的最小成对测试数据集的生成算法,在一定程度上对成对测试领域起到了积极作用,理论及实验表明,该算法能有效的提高测试用例的生成效果。
The testing of software is a process that uses a group of testing data designed according to the specification and configuration of program to discover the mistakes inside the program. The testing of software is a logical and coherent work. It is an action with risk. The aim of testing of software is to discover errors, to evaluate the degree of test, but not to justify its correctness. It is expected to find out errors and bugs in software. The methods and techniques of testing of software were various. This paper focuses on investigating pairwise test and the content of this paper is as follows:
Firstly, this paper introduces the characteristic, significance and situation of software testing; and then it introduces some test methods and emphasizes pairwise test. After that, it introduces the principles, concepts and directions of software testing of pairwise test, and analyses the advantages and disadvantages. Finally, it introduces a new algorithm of pairwise test data creation.
This paper promotes a data creation algorithm for pairwise test based on extended cyclic matrix. Theoretical analyses and simulation experiments show that, when the input field equals to the parameter field and is a prime number, the algorithm fulfills the requirement of the test. Based on this algorithm, this paper discusses the least pairwise test data set with the input field not equal to the parameter field. Finally, this paper conducts analysis on cases where the input field and the parameter field are not prime number, obtaining the minimum pairwise test data set of four, and estimating the cases with number six and more.
The algorithm of minimum pairwise test data set promoted by this paper brings positive influences to testing field. Theoretical analysis and simulation experiments show that the algorithm can improve the effect of test set generation.
本文首先介绍软件测试的特点、意义及研究现状;然后介绍了一些常见的软件测试的方法,并重点介绍了组合测试;接着介绍了成对测试的基本原理、相关概念和目前的发展趋势,并分析了其优缺点;最后介绍了一种新的成对测试数据生成算法。
在组合测试中的两两组合领域中,本文提出了一种基于扩展循环矩阵的测试数据生成算法,理论分析和模拟实验表明,当输入域及参数域相同且均为质数时,该算法能非常完美的实现成对组合测试数据集的要求;接着,本文在此算法的基础上,充分讨论了当输入域及参数域不同时最小成对测试数据集的生成;最后,本文针对输入域及参数域为合数的情况做了理论分析,得出了当输入域为四的最小成对测试数据集,并对六及六以后的合数做了初步的估计。
本文所提出的基于扩展循环矩阵的最小成对测试数据集的生成算法,在一定程度上对成对测试领域起到了积极作用,理论及实验表明,该算法能有效的提高测试用例的生成效果。
The testing of software is a process that uses a group of testing data designed according to the specification and configuration of program to discover the mistakes inside the program. The testing of software is a logical and coherent work. It is an action with risk. The aim of testing of software is to discover errors, to evaluate the degree of test, but not to justify its correctness. It is expected to find out errors and bugs in software. The methods and techniques of testing of software were various. This paper focuses on investigating pairwise test and the content of this paper is as follows:
Firstly, this paper introduces the characteristic, significance and situation of software testing; and then it introduces some test methods and emphasizes pairwise test. After that, it introduces the principles, concepts and directions of software testing of pairwise test, and analyses the advantages and disadvantages. Finally, it introduces a new algorithm of pairwise test data creation.
This paper promotes a data creation algorithm for pairwise test based on extended cyclic matrix. Theoretical analyses and simulation experiments show that, when the input field equals to the parameter field and is a prime number, the algorithm fulfills the requirement of the test. Based on this algorithm, this paper discusses the least pairwise test data set with the input field not equal to the parameter field. Finally, this paper conducts analysis on cases where the input field and the parameter field are not prime number, obtaining the minimum pairwise test data set of four, and estimating the cases with number six and more.
The algorithm of minimum pairwise test data set promoted by this paper brings positive influences to testing field. Theoretical analysis and simulation experiments show that the algorithm can improve the effect of test set generation.
引文
[1] Chen H Y, Tse T H , Chen T Y. TACCLE: A Methodology for Object-Oriented Software Testing at the Class and Cluster Levels. ACM Transactions on Software Engineering and Methodology , 2001, 10 (4) : 56-109
[2]黄小城,王希武等.基于微分进化算法的软件测试数据自动生成.四川兵工学报.第30卷第3期.
[3]何新贵.软件测试技术综述.中国计量学院学报.Vol.19 No.3 Sep.2008
[4]邱小玲.浅谈软件测试的方法.SCIENCE & TECHNOLOGY INFORMATION(科技信息).2008年第17期.
[5]徐大圣,李晨迅,梅华威.软件测试方法的分析与研究.现代商贸工业2008年第9期.
[6]吴艳,张惠.基于模型的软件测试方法研究.计算机系统应用.2008年第8期.
[7]朱少民.软件测试方法与技术[M].北京:清华大学出版社,2005.
[8] Paul C.Jorgensen.软件测试[M].韩柯,杜旭涛,译.北京:机械工业出版社,2003.
[9]郑人杰.软件测试技术[M].北京:清华大学出版社,1992.
[10]宫云战.软件测试[M].北京:国防工业出版社,2006:68-72.
[11]古乐,史九林.软件测试技术概论[M].北京:清华大学出版社.2004.
[12]邢恺,伦立军.测试数据自动生成方法[J].计算机技术与发展.2006,9(16):53-55
[13]傅博.基于蚁群算法的软件测试数据自动生成[J].计算机工程与应用, 2007,43(12):97—99。
[14]郭斌,高海昌,冯博琴,等.基于自适应SAGA的测试数据自动生成[J].微电子学与计算机,2006,8(23):10-13.
[15]王捷民,丁刚毅,宋瀚涛,等.基于改进的自适应遗传算法HCGA的测试数据自动生成[J].北京理工大学报,2007,10(27):883-885
[16]程烨,高建华,齐丽娜.基于遗传算法的类对象测试数据自动生成研究[J].计算机应用,2006,8(26):1953-1955.
[17]齐治平,谭庆平,宁洪.软件工程[M].北京:高等教育出版社,2003.
[18]朱云鹏.基于故障树分析法的软件测试技术研究.计算机工程与设计.Vol.29 No.13
[19] Jeff Offutt,Shaoying Liu.Generating testing data from SOFLSpecification[J].The Journal of systems and Software,1999,49(1):49～62
[20] Parrish.A,S,Boric.R B,Cordes,D.W,Automated flow graph-based testing of object-oriented software modules[J].J Systems Software,1993,(23):95～109.
[21]夏镇,饶若楠.一种基于正交表的功能组合测试设计方法.Microcomputer Applic-ations Vol.23,No.3,2007.
[22]牛为华,孟建良,张素文.成对测试中的测试生成策略研究.计算机仿真2003年7月第20卷第7期.
[23]向渝,张骏,汪文勇.成对测试中的一种用例.电子科技大学学报Vol.34 No.6 Dec.2005.
[24]奚水清,胡飞.基于模型的嵌入式软件测试.微处理机.No.1 Feb,2009
[25]徐宏喆，陈建明，张昊翔,等.UML自动化测试技术[M].西安交通大学出版社,2006.
[26]谢棠棠,张为群.一种基于UML模型的系统测试方法[J].西南师范大学学报:自然科学版,2005,30(2):259-263.
[27] DAN Pilone,NEIL Pitman.UML 2.0 in a nutshell[D].Southeast University Pre,2006.
[28] RON Patton.Software testing[M].China Machine Press,2006.
[29]周飞,杨根兴,蔡立志.基于UML的测试用例生成方法研究.计算机应用.Vol.26 No.2 Feb.2009.
[30]孙淑香,侯秀萍,蔡文涛.基于树型模型的黑盒测试用例自动生成.计算机技术与发展.Vol.19 No.2 Feb.2009
[31] DeMillo R.Experimental results from an automatic test case generator[J].ACM Transactions On Software Engineering Methodology,1993,2(2):109—175.
[32] DeMillo R. Constraint based automatic test data generation [J].IEEE Transactions on Software Engineering, 1991, 17(9):900-910.
[33] Chen T Y. A new heuristic for test suite reduction [J]. Information and Software Technology, 1998, 40(5-6):347-354.
[34] Jeff Offutt, Shaoying Liu. Generating testing data from SOFL Specification [J]. The Journal of systems and Software, 1999, 49(1):49-62.
[35] B.A. MyerS. User Interface Software Tools, ACM Trans [J].Computer-human Interaetion, 1995, 2(1):64-103.
[36] Parrish.A.S,Boric.R B,Cordes,D.W,Automated flow graph-based testing of object-oriented software modules[J].J Systems Software,1993,(23):95～109
[37] Cohen D M, Dalal S R, Parelius J, et al. The combinatorial design approach to automatic test generation. IEEE Software, 1996, 13 (5): 83-87.
[38] Cohen D M, Dalal S R, Fredman M L, et al. The AETG system: An approach to testing based on combinatorial design. IEEE Transaction on Software Engineering , 1997, 23 (7):437-444.
[39] Tai K C, Lei Y. A test generation strategy for pairwise testing. IEEE -Transactions on Software Engineering , 2002 , 28(1):109-111.
[40]聂长海,徐宝文.基于接口参数的黑箱测试用例自动生成算法.计算机学报, 2004,27(3):382-388.
[41]聂长海,徐宝文,史亮.一种新的二水平多因素系统两两组合覆盖测试数据生成算法.计算机学报, 2006,29(6): 841-848.
[42] Kobayashi N, Tsuchiya T, Kikuno T. A new method for constructing pair-wise covering designs for software testing. Information Processing Lett-ers , 2002, 81 (2): 85-91.
[43] Williams A W. Software component interaction testing: Coverage measure-ment and generation of configurations [dissertation]. Ottawa : Universi-ty of Ottawa , 2002,22-41.
[44] Schoeder P J. Black-box test reduction using input-output analysis [di-ssertation]. Chicago: Illinois Institute of Technology, 2001,10-17.
[45]史亮,聂长海,徐宝文.基于解空间树的组合测试数据生成,计算机学报. 2006, 29(6): 849-857.
[46]杨德红.基于组合模型的高效黑盒测试用例设计.现代电子技术.2009年第8期.
[47]刘维光.面向对象软件测试方法的研究[J].电脑知识与技术,2006(29):168一169.
[48] Daniel J. Monley, Bruce A. posey. Software Test Automation. U.S.A.: Yourdon Press, 2002:39-43.
[49] PATRON R.软件测试[M].北京:机械工业出版社,2004.
[2]黄小城,王希武等.基于微分进化算法的软件测试数据自动生成.四川兵工学报.第30卷第3期.
[3]何新贵.软件测试技术综述.中国计量学院学报.Vol.19 No.3 Sep.2008
[4]邱小玲.浅谈软件测试的方法.SCIENCE & TECHNOLOGY INFORMATION(科技信息).2008年第17期.
[5]徐大圣,李晨迅,梅华威.软件测试方法的分析与研究.现代商贸工业2008年第9期.
[6]吴艳,张惠.基于模型的软件测试方法研究.计算机系统应用.2008年第8期.
[7]朱少民.软件测试方法与技术[M].北京:清华大学出版社,2005.
[8] Paul C.Jorgensen.软件测试[M].韩柯,杜旭涛,译.北京:机械工业出版社,2003.
[9]郑人杰.软件测试技术[M].北京:清华大学出版社,1992.
[10]宫云战.软件测试[M].北京:国防工业出版社,2006:68-72.
[11]古乐,史九林.软件测试技术概论[M].北京:清华大学出版社.2004.
[12]邢恺,伦立军.测试数据自动生成方法[J].计算机技术与发展.2006,9(16):53-55
[13]傅博.基于蚁群算法的软件测试数据自动生成[J].计算机工程与应用, 2007,43(12):97—99。
[14]郭斌,高海昌,冯博琴,等.基于自适应SAGA的测试数据自动生成[J].微电子学与计算机,2006,8(23):10-13.
[15]王捷民,丁刚毅,宋瀚涛,等.基于改进的自适应遗传算法HCGA的测试数据自动生成[J].北京理工大学报,2007,10(27):883-885
[16]程烨,高建华,齐丽娜.基于遗传算法的类对象测试数据自动生成研究[J].计算机应用,2006,8(26):1953-1955.
[17]齐治平,谭庆平,宁洪.软件工程[M].北京:高等教育出版社,2003.
[18]朱云鹏.基于故障树分析法的软件测试技术研究.计算机工程与设计.Vol.29 No.13
[19] Jeff Offutt,Shaoying Liu.Generating testing data from SOFLSpecification[J].The Journal of systems and Software,1999,49(1):49～62
[20] Parrish.A,S,Boric.R B,Cordes,D.W,Automated flow graph-based testing of object-oriented software modules[J].J Systems Software,1993,(23):95～109.
[21]夏镇,饶若楠.一种基于正交表的功能组合测试设计方法.Microcomputer Applic-ations Vol.23,No.3,2007.
[22]牛为华,孟建良,张素文.成对测试中的测试生成策略研究.计算机仿真2003年7月第20卷第7期.
[23]向渝,张骏,汪文勇.成对测试中的一种用例.电子科技大学学报Vol.34 No.6 Dec.2005.
[24]奚水清,胡飞.基于模型的嵌入式软件测试.微处理机.No.1 Feb,2009
[25]徐宏喆，陈建明，张昊翔,等.UML自动化测试技术[M].西安交通大学出版社,2006.
[26]谢棠棠,张为群.一种基于UML模型的系统测试方法[J].西南师范大学学报:自然科学版,2005,30(2):259-263.
[27] DAN Pilone,NEIL Pitman.UML 2.0 in a nutshell[D].Southeast University Pre,2006.
[28] RON Patton.Software testing[M].China Machine Press,2006.
[29]周飞,杨根兴,蔡立志.基于UML的测试用例生成方法研究.计算机应用.Vol.26 No.2 Feb.2009.
[30]孙淑香,侯秀萍,蔡文涛.基于树型模型的黑盒测试用例自动生成.计算机技术与发展.Vol.19 No.2 Feb.2009
[31] DeMillo R.Experimental results from an automatic test case generator[J].ACM Transactions On Software Engineering Methodology,1993,2(2):109—175.
[32] DeMillo R. Constraint based automatic test data generation [J].IEEE Transactions on Software Engineering, 1991, 17(9):900-910.
[33] Chen T Y. A new heuristic for test suite reduction [J]. Information and Software Technology, 1998, 40(5-6):347-354.
[34] Jeff Offutt, Shaoying Liu. Generating testing data from SOFL Specification [J]. The Journal of systems and Software, 1999, 49(1):49-62.
[35] B.A. MyerS. User Interface Software Tools, ACM Trans [J].Computer-human Interaetion, 1995, 2(1):64-103.
[36] Parrish.A.S,Boric.R B,Cordes,D.W,Automated flow graph-based testing of object-oriented software modules[J].J Systems Software,1993,(23):95～109
[37] Cohen D M, Dalal S R, Parelius J, et al. The combinatorial design approach to automatic test generation. IEEE Software, 1996, 13 (5): 83-87.
[38] Cohen D M, Dalal S R, Fredman M L, et al. The AETG system: An approach to testing based on combinatorial design. IEEE Transaction on Software Engineering , 1997, 23 (7):437-444.
[39] Tai K C, Lei Y. A test generation strategy for pairwise testing. IEEE -Transactions on Software Engineering , 2002 , 28(1):109-111.
[40]聂长海,徐宝文.基于接口参数的黑箱测试用例自动生成算法.计算机学报, 2004,27(3):382-388.
[41]聂长海,徐宝文,史亮.一种新的二水平多因素系统两两组合覆盖测试数据生成算法.计算机学报, 2006,29(6): 841-848.
[42] Kobayashi N, Tsuchiya T, Kikuno T. A new method for constructing pair-wise covering designs for software testing. Information Processing Lett-ers , 2002, 81 (2): 85-91.
[43] Williams A W. Software component interaction testing: Coverage measure-ment and generation of configurations [dissertation]. Ottawa : Universi-ty of Ottawa , 2002,22-41.
[44] Schoeder P J. Black-box test reduction using input-output analysis [di-ssertation]. Chicago: Illinois Institute of Technology, 2001,10-17.
[45]史亮,聂长海,徐宝文.基于解空间树的组合测试数据生成,计算机学报. 2006, 29(6): 849-857.
[46]杨德红.基于组合模型的高效黑盒测试用例设计.现代电子技术.2009年第8期.
[47]刘维光.面向对象软件测试方法的研究[J].电脑知识与技术,2006(29):168一169.
[48] Daniel J. Monley, Bruce A. posey. Software Test Automation. U.S.A.: Yourdon Press, 2002:39-43.
[49] PATRON R.软件测试[M].北京:机械工业出版社,2004.