回归测试用例选择技术研究
|
摘要
在软件的开发和维护过程中,为了增强软件的功能和修正软件的错误,需要对软件进行变更。变更完成后,为了验证变更的效果,需要对于软件系统进行回归测试。传统上,回归测试就是重新运行回归测试用例集的测试过程。回归测试是非常昂贵的,回归测试优化技术是一种节省回归测试高昂花费的优化技术。回归测试用例选择技术是最重要的回归测试优化技术。回归测试用例选择技术计算出程序新旧版本之间的变更,选择所有覆盖了变更部分的回归测试用例,计算出回归测试用例选择集。回归测试的过程不再是重新运行回归测试用例集,而是重新运行回归测试用例选择集。通过减少重新运行的回归测试用例的数量来节省回归测试过程的花销。Java虚拟机的兴起、基于构件的开发范式和持续集成的广泛应用对回归测试用例选择技术提出了新的挑战。为了应对这些新挑战,新一代的回归测试用例选择算法必须是基于字节码的、满足增量性质的和支持面向对象特性。基于对完整Java字节码指令集的分析,提出了一种无需Java源代码,直接基于Java字节码构造控制流图的算法。并且基于字节码直接构造的控制流图,提出了一种基于字节码控制流图的回归测试用例选择算法。基于字节码控制流图的回归测试用例选择算法直接分析程序新旧版本的字节码,构造出新旧版本的控制流图。然后对比新旧版本的控制流图,计算出程序的变更。最后,将所有覆盖了程序变更部分的回归测试用例加入回归测试用例选择集。该算法无需源代码,支持完整的Java字节码指令集,特别是支持Java特有的异常特性。Java程序中类型之间的继承关系和使用关系构成了类型之间的依赖关系。基于自动构造和维护的依赖关系,提出了一种Java语言的增量编译算法。相比于完全编译算法,增量编译算法能够最大限度的减少不必要的重新编译过程。进一步,基于Java语言的增量编译算法,提出了一种类层次的回归测试用例选择算法。由于增量编译算法输出的所有重新编译输出的字节码文件集合代表着程序的变更部分。因此,类层次的回归测试用例选择算法只需选择出所有覆盖了程序变更部分的回归测试用例,将其加入回归测试用例选择集。类层次回归测试用例选择算法不仅支持Java面向对象中的继承等特性,而且满足增量性质。算法的时间复杂度不再正比于程序的总规模,而是正比于程序新旧版本之间的变更规模。一般说来,由于程序的总规模很大,变更规模很小。所以具有增量性质的回归测试用例选择算法运算效率高。不管是基于字节码控制流图的回归测试用例选择算法,还是类层次回归测试用例选择算法,都需要计算出程序新旧版本之间基于语法的变更。提出了一种基于语法的变更算法,能够计算Java程序新旧版本字节码之间基于语法的变更。该算法首先将Java程序新旧版本的字节码直接转化为XML数据结构,然后对比新旧版本的XML数据结构,最后计算出基于语法的变更。不同于将源代码简单的看作是文本文件,使用文本行的增加、删除和更新作为程序新旧版本之间变更结果的传统变更算法。基于语法的变更算法没有忽略Java程序的语法信息,基于语法的变更结果适合回归测试用例选择算法的需要。此外,还提出了将基于语法的变更结果进一步分解为原子变更的方法,并且分析了Java语言原子变更的二进制兼容性和源代码兼容性。
During the develop phase and maintain phase of the software project, it need change software to enhance the functionality and fix the bugs of the software project. After the programmer finishes the coding works for the new version software, it need run regression testing for validating the diff between the old version and new version software. In general, the regression testing process rerun all test cases in the regression testing suite. But the regression testing is the expensive phase of the software testing, the optimization regression testing techniques can save the total costs of the regression testing.The regression testing selection(RTS) is the most important technique in the optimization regression testing techniques. The regression testing selection technique diffs between the old version and new version software, and selects all test cases into the selected regression testing suite that cover the diff portions of the software. The process of optimization regression testing do not rerun all test cases in the regression testing suite, but only rerun the selected regression testing suite. The optimization regression testing saves the total costs by saving the numbers of rerunning test cases.The booming of the Java virtual machine platform and the rapid rate of adoption of the component-based development and continuous integration set new challenges for the regression testing selection techniques. To tackle these three new challenges, the new regression testing techniques must have bytecode-based, incremental and object-oriented properties.Based on the analysis for the full Java bytecode instructions set, this paper presents a bytecode based algorithm to compute the Control Flow Graph(CFG). The CFG algorithm does not need Java source code and can directly compute CFG from Java bytecode. It also presents a CFG-based regression testing selection algorithm. The CFG-based regression testing selection algorithm directly analyzes the bytecode of the old version and new version of the software, and then compute control flow graphs. It compares the old version and new version control flow graphs of the software and outputs the diff. Finally, it selects all test cases in the regression testing suite that cover the diff portions of the software and outputs the selected regression testing suite. The algorithm supports full Java bytecode instructions set and does not need the source code of the software, especially it supports the exception feature of the Java programming language.The dependency relationship is composed of the inheritance relationship and use relationship in the Java programming language. Based on the automatically created and updated dependency relationship information, this paper presents an incremental compilation algorithm for the Java programming language. Comparing with the batch compilation algorithm, the incremental compilation algorithm can avoid redundant recompilation works to save total compilation costs. Based on the Java incremental compilation algorithm, it presents a class level regression testing selection algorithm. Because the incremental compilation algorithm outputs all recompiled bytecode files that is composed of the class level diff between old version and new version of the software, the class level regression testing selection algorithm only selects all test cases in the regression testing suite that cover the diff portions of the software and output selected regression testing suite. The class level regression testing selection algorithm not only supports the inheritance feature of the object-oriented Java programming language but also have incremental property. The cost of the class level regression testing selection algorithm is proportion with the size of diff portions between old version and new version of the software and is not proportion with the total size of the software. Because the size of diff is much smaller than the total size of the software in general, so the class level regression testing selection algorithm has incremental property and is more efficient that the batch algorithm.The control flow graph based regression testing selection algorithm and class level regression testing algorithm both need syntax based diff between the old version and new version of the software. This paper presents a syntax based diff algorithm that output the difference of the old version and new version in bytecode format. The syntax based diff algorithm converts the old version and new version bytecode into the XML data structure at first, and then compares the old version and new version XML data structures and outputs the syntax based diff. The non syntax based diff algorithm only assumes the Java program to be the simple text files and totally ignores the syntax information of the Java programming language. The non syntax based diff algorithm outputs non syntax diff that is composed of inserted, deleted and changed text lines. But the syntax diff algorithm outputs syntax diff that contains full Java syntax information and fulfills the needs of the regression testing selection algorithms. It also presents the method that decomposes the syntax diff into atomic change set, and also analyzes the differences of the binary compatibility and source compatibility of the atomic change.
During the develop phase and maintain phase of the software project, it need change software to enhance the functionality and fix the bugs of the software project. After the programmer finishes the coding works for the new version software, it need run regression testing for validating the diff between the old version and new version software. In general, the regression testing process rerun all test cases in the regression testing suite. But the regression testing is the expensive phase of the software testing, the optimization regression testing techniques can save the total costs of the regression testing.The regression testing selection(RTS) is the most important technique in the optimization regression testing techniques. The regression testing selection technique diffs between the old version and new version software, and selects all test cases into the selected regression testing suite that cover the diff portions of the software. The process of optimization regression testing do not rerun all test cases in the regression testing suite, but only rerun the selected regression testing suite. The optimization regression testing saves the total costs by saving the numbers of rerunning test cases.The booming of the Java virtual machine platform and the rapid rate of adoption of the component-based development and continuous integration set new challenges for the regression testing selection techniques. To tackle these three new challenges, the new regression testing techniques must have bytecode-based, incremental and object-oriented properties.Based on the analysis for the full Java bytecode instructions set, this paper presents a bytecode based algorithm to compute the Control Flow Graph(CFG). The CFG algorithm does not need Java source code and can directly compute CFG from Java bytecode. It also presents a CFG-based regression testing selection algorithm. The CFG-based regression testing selection algorithm directly analyzes the bytecode of the old version and new version of the software, and then compute control flow graphs. It compares the old version and new version control flow graphs of the software and outputs the diff. Finally, it selects all test cases in the regression testing suite that cover the diff portions of the software and outputs the selected regression testing suite. The algorithm supports full Java bytecode instructions set and does not need the source code of the software, especially it supports the exception feature of the Java programming language.The dependency relationship is composed of the inheritance relationship and use relationship in the Java programming language. Based on the automatically created and updated dependency relationship information, this paper presents an incremental compilation algorithm for the Java programming language. Comparing with the batch compilation algorithm, the incremental compilation algorithm can avoid redundant recompilation works to save total compilation costs. Based on the Java incremental compilation algorithm, it presents a class level regression testing selection algorithm. Because the incremental compilation algorithm outputs all recompiled bytecode files that is composed of the class level diff between old version and new version of the software, the class level regression testing selection algorithm only selects all test cases in the regression testing suite that cover the diff portions of the software and output selected regression testing suite. The class level regression testing selection algorithm not only supports the inheritance feature of the object-oriented Java programming language but also have incremental property. The cost of the class level regression testing selection algorithm is proportion with the size of diff portions between old version and new version of the software and is not proportion with the total size of the software. Because the size of diff is much smaller than the total size of the software in general, so the class level regression testing selection algorithm has incremental property and is more efficient that the batch algorithm.The control flow graph based regression testing selection algorithm and class level regression testing algorithm both need syntax based diff between the old version and new version of the software. This paper presents a syntax based diff algorithm that output the difference of the old version and new version in bytecode format. The syntax based diff algorithm converts the old version and new version bytecode into the XML data structure at first, and then compares the old version and new version XML data structures and outputs the syntax based diff. The non syntax based diff algorithm only assumes the Java program to be the simple text files and totally ignores the syntax information of the Java programming language. The non syntax based diff algorithm outputs non syntax diff that is composed of inserted, deleted and changed text lines. But the syntax diff algorithm outputs syntax diff that contains full Java syntax information and fulfills the needs of the regression testing selection algorithms. It also presents the method that decomposes the syntax diff into atomic change set, and also analyzes the differences of the binary compatibility and source compatibility of the atomic change.
引文
[1] Harrold MJ. Reduce, reuse, recycle, recover:Techniques for improved regression testing. In:Software Maintenance,2009. ICSM 2009. IEEE International Conference on; 2009; 5-5
[2] Lindholm T, Yellin F. Java Virtual Machine Specification:Addison-Wesley Longman Publishing Co., Inc.; 1999
[3] Ryder BG, Tip F. Change impact analysis for object-oriented programs. In: Proceedings of the 2001 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering. Snowbird, Utah, United States:ACM; 2001
[4] Kung-Kiu L, Zheng W. Software Component Models[J]. Software Engineering, IEEE Transactions on,2007,33(10):709-724
[5] Harrold MJ. Testing:a roadmap. In:Proceedings of the Conference on The Future of Software Engineering. Limerick, Ireland:ACM; 2000
[6] Rehman MJ-u, Jabeen F, Bertolino A et al. Testing software components for integration:a survey of issues and techniques[J]. Software Testing, Verification and Reliability,2007,17(2):95-133
[7] Boehm B. A view of 20th and 21st century software engineering. In:Proceedings of the 28th international conference on Software engineering. Shanghai, China:ACM; 2006:12-29
[8] Saff D, Ernst MD. Continuous testing in eclipse. In:Proceedings of the 27th international conference on Software engineering. St. Louis, MO, USA:ACM; 2005:668-669
[9] Saff D, Ernst MD. An experimental evaluation of continuous testing during development. In:Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis. Boston, Massachusetts, USA:ACM; 2004:76-85
[10] Bertolino A. Software Testing Research:Achievements, Challenges, Dreams. In: 2007 Future of Software Engineering:IEEE Computer Society; 2007
[11] Yoo S, Harman M. Regression testing minimization, selection and prioritization:a survey[J]. Software Testing, Verification and Reliability,2010
[12] Zhu H, Hall PAV, May JHR. Software unit test coverage and adequacy[J]. ACM Comput. Surv,1997,29(4):366-427
[13] Engstrom E, Runeson P, Skoglund M. A systematic review on regression test selection techniques[J]. Information and Software Technology,2010,52(1):14-30
[14] Engstrom E, Skoglund M, Runeson P. Empirical evaluations of regression test selection techniques:a systematic review. In:Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement. Kaiserslautern, Germany:ACM; 2008:22-31
[15] Harrold MJ, Orso A. Retesting software during development and maintenance. In: Frontiers of Software Maintenance,2008. FoSM 2008.; 2008; 99-108
[16] Harrold MJ, Souffa ML. An incremental approach to unit testing during maintenance. In:Software Maintenance,1988., Proceedings of the Conference on; 1988 24-27 Oct 1988; 362-367
[17] Taha AB, Thebaut SM, Liu SS. An approach to software fault localization and revalidation based on incremental data flow analysis. In:Computer Software and Applications Conference,1989. COMPSAC 89., Proceedings of the 13th Annual International; 1989 20-22 Sep 1989; 527-534
[18] Laski J, Szermer W. Identification of program modifications and its applications in software maintenance. In:Software Maintenance,1992. Proceerdings., Conference on; 1992 9-12 Nov 1992; 282-290
[19] Vokolos FI, Frankl PG. Pythia:a regression test selection tool based on textual differencing. In:IFIP TC5 WG5.4 3rd internatinal conference on on Reliability, quality and safety of software-intensive systems. Athens, Greece:Chapman & Hall, Ltd. London, UK,1997:3-21
[20] Vokolos FI, Frankl PG. Empirical evaluation of the textual differencing regression testing technique. In:Software Maintenance,1998. Proceedings. International Conference on; 1998; 44-53
[21] Wong WE, Horgan JR, London S et al. A Study of Effective Regression Testing in Practice. In:Proceedings of the Eighth International Symposium on Software Reliability Engineering:IEEE Computer Society; 1997:264
[22] Leung HKN, White L. A study of integration testing and software regression at the integration level. In:Software Maintenance,1990., Proceedings., Conference on; 1990 26-29 Nov 1990; 290-301
[23] White LJ, Leung HKN. A firewall concept for both control-flow and data-flow in regression integration testing. In:Software Maintenance,1992. Proceerdings., Conference on; 1992; 262-271
[24] White L, Robinson B. Industrial Real-Time Regression Testing and Analysis Using Firewalls. In:Proceedings of the 20th IEEE International Conference on Software Maintenance:IEEE Computer Society; 2004
[25] Hartmann J, Robson DJ. Revalidation during the software maintenance phase. In: Software Maintenance,1989., Proceedings., Conference on; 1989 16-19 Oct 1989; 70-80
[26] Chen Y-F, Rosenblum DS, Vo K-P. TestTube:a system for selective regression testing. In:Proceedings of the 16th international conference on Software engineering. Sorrento, Italy:IEEE Computer Society Press; 1994
[27] Rothermel G, Harrold MJ. A safe, efficient algorithm for regression test selection. In: Software Maintenance,1993. CSM-93, Proceedings., Conference on; 1993 27-30 Sep 1993; 358-367
[28] Rothermel G, Harrold MJ. A framework for evaluating regression test selection techniques. In:Proceedings of the 16th international conference on Software engineering. Sorrento, Italy:IEEE Computer Society Press; 1994:201-210
[29] Rothermel G, Harrold MJ. Selecting tests and identifying test coverage requirements for modified software. In:Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis. Seattle, Washington, United States: ACM; 1994:169-184
[30] Rothermel G. Efficient, effective regression testing using safe test selection techniques [Ph.D.]. United States--South Carolina:Clemson University; 1996
[31] Rothermel G, Harrold MJ. Analyzing regression test selection techniques[J]. Software Engineering, IEEE Transactions on,1996,22(8):529-551
[32] Rothermel G, Harrold MJ. A safe, efficient regression test selection technique[J]. ACM Trans. Softw. Eng. Methodol,1997,6(2):173-210
[33] Ball T. On the limit of control flow analysis for regression test selection. In: Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis. Clearwater Beach, Florida, United States:ACM; 1998:134-142
[34] Bible J, Rothermel G, Rosenblum DS. A comparative study of coarse-and fine-grained safe regression test-selection techniques [J]. ACM Trans. Softw. Eng. Methodol,2001,10(2):149-183
[35] Kung D, Gao J, Hsia P et al. Developing an object-oriented software testing and maintenance environment[J]. Commun. ACM,1995,38(10):75-87
[36] White L, Jaber K, Robinson B. Utilization of extended firewall for object-oriented
regression testing. In:Software Maintenance,2005. ICSM'05. Proceedings of the 21st IEEE International Conference on; 200526-29 Sept.2005; 695-698
[37] White L, Jaber K, Robinson B et al. Extended firewall for regression testing:an experience report[J]. Journal of Software Maintenance and Evolution:Research and Practice,2008,20(6):419-433
[38] Ren X, Shah F, Tip F et al. Chianti:a tool for change impact analysis of Java programs. In:Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Vancouver, BC, Canada:ACM; 2004:432-448
[39] Ren X. Change impact analysis for Java programs and applications [3319680]. United States-New Jersey:Rutgers The State University of New Jersey-New Brunswick; 2007
[40] Wloka J, Ryder B, Tip F et al. Safe-commit analysis to facilitate team software development. In:Proceedings of the 31st International Conference on Software Engineering:IEEE Computer Society; 2009:507-517
[41] Rothermel G, Harrold MJ, Dedhia J. Regression test selection for C++software[J]. Software Testing, Verification and Reliability,2000,10(2):77-109
[42] Harrold MJ, Jones JA, Li T et al. Regression test selection for Java software. In: Proceedings of the 16th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Tampa Bay, FL, USA:ACM; 2001
[43] Koju T, Takada S, Doi N. Regression Test Selection based on Intermediate Code for Virtual Machines. In:Proceedings of the International Conference on Software Maintenance:IEEE Computer Society; 2003
[44]方菲孙,王立福,杨芙清.面向对象软件回归测试技术研究[J].软件学报,2001,(03)
[45]顾玉良,周淑秋.面向对象程序回归测试策略研究[J].计算机科学,2000,(08)
[46] Hilsdale E, Hugunin J. Advice weaving in AspectJ. In:Proceedings of the 3rd international conference on Aspect-oriented software development. Lancaster, UK: ACM; 2004:26-35
[47] Zhao J, Xie T, Li N. Towards regression test selection for AspectJ programs. In: Proceedings of the 2nd workshop on Testing aspect-oriented programs. Portland, Maine:ACM; 2006:21-26
[48] Xu G, Rountev A. Regression Test Selection for AspectJ Software. In:Proceedings
of the 29th international conference on Software Engineering:IEEE Computer Society; 2007:65-74
[49] Mahdian A, Andrews AA, Pilskalns OJ. Regression testing with UML software designs:A survey[J]. Journal of Software Maintenance and Evolution:Research and Practice,2009,21(4):253-286
[50] Briand LC, Labiche Y, He S. Automating regression test selection based on UML designs[J]. Inf. Softw. Technol,2009,51(1):16-30
[51] Chen Y, Probert RL, Ural H. Regression test suite reduction based on SDL models of system requirements [J]. Journal of Software Maintenance and Evolution:Research and Practice,2009,21(6):379-405
[52] Zheng J. In regression testing selection when source code is not available. In: Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering. Long Beach, CA, USA:ACM; 2005:752-755
[53] Zheng J, Robinson B, Williams L et al. Applying regression test selection for COTS-based applications. In:Proceedings of the 28th international conference on Software engineering. Shanghai, China:ACM; 2006
[54] Zheng J, Williams L, Robinson B. Pallino:automation to support regression test selection for cots-based applications. In:Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering. Atlanta, Georgia, USA:ACM; 2007
[55] Zheng J. In regression testing without code [Ph.D.]. United States-North Carolina: North Carolina State University; 2007
[56] Orso A, Harrold MJ, Rosenblum D et al. Using component metacontent to support the regression testing of component-based software. In:Software Maintenance,2001. Proceedings. IEEE International Conference on; 2001; 716-725
[57] Orso A, Do H, Rothermel G et al. Using component metadata to regression test component-based software[J]. Software Testing, Verification and Reliability,2007, 17(2):61-94
[58]毛澄映,卢炎生.构件软件回归测试用例选择策略[J].计算机研究与发展,2006,(10)
[59]马良荔,郭福亮,李永杰.基于变更模型的元数据在构件回归测试中的应用研究[J].计算机科学,2008,(05)
[60] Tichy WF. Smart recompilation[J]. ACM Trans. Program. Lang. Syst,1986,8(3):
273-291
[61] Schwanke RW, Kaiser GE. Smarter recompilation[J]. ACM Trans. Program. Lang. Syst,1988,10(4):627-632
[62] Drossopoulou S, Eisenbach S, Wragg D. A Fragment Calculus Towards a Model of Separate Compilation, Linking and Binary Compatibility. In:Proceedings of the 14th Annual IEEE Symposium on Logic in Computer Science:IEEE Computer Society; 1999:147
[63]Dmitriev M. Language-specific make technology for the Java programming language. In:Proceedings of the 17th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Seattle, Washington, USA: ACM; 2002:373-385
[64] Forman IR, Conner MH, Danforth SH et al. Release-to-release binary compatibility in SOM. In:Proceedings of the tenth annual conference on Object-oriented programming systems, languages, and applications. Austin, Texas, United States: ACM; 1995:426-438
[65] Gosling J, Joy B, Steele G et al. The Java Language Specification, Third Edition.3 ed:Addison Wesley; 2005
[66] Drossopoulou S, Wragg D, Eisenbach S. What is Java binary compatibility? In: Proceedings of the 13th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Vancouver, British Columbia, Canada:ACM; 1998:341-361
[67] Graves TL, Harrold MJ, Kim J et al. An empirical study of regression test selection techniques. In:Software Engineering,1998. Proceedings of the 1998 International Conference on; 1998 19-25 Apr 1998; 188-197
[68] Graves TL, Harrold MJ, Kim J-M et al. An empirical study of regression test selection techniques [J]. ACM Trans. Softw. Eng. Methodol,2001,10(2):184-208
[69] Kim J-M, Porter A, Rothermel G. An empirical study of regression test application frequency[J]. Software Testing, Verification and Reliability,2005,15(4):257-279
[70] Rothermel G, Elbaum S, Malishevsky A et al. The impact of test suite granularity on the cost-effectiveness of regression testing. In:Proceedings of the 24th International Conference on Software Engineering. Orlando, Florida:ACM; 2002:130-140
[71] Rothermel G, Elbaum S, Malishevsky AG et al. On test suite composition and cost-effective regression testing[J]. ACM Trans. Softw. Eng. Methodol,2004,13(3): 277-331
[72] Rothermel G, Harrold MJ, Ostrin J et al. An Empirical Study of the Effects of Minimization on the Fault Detection Capabilities of Test Suites. In:Proceedings of the International Conference on Software Maintenance:IEEE Computer Society; 1998:34
[73] Do H. Accounting for context and lifetime factors:A new approach for evaluating regression testing techniques [Ph.D.]. United States-Nebraska:The University of Nebraska-Lincoln; 2007
[74] Do H, Elbaum S, Rothermel G. Infrastructure Support for Controlled Experimentation with Software Testing and Regression Testing Techniques. In: Proceedings of the 2004 International Symposium on Empirical Software Engineering:IEEE Computer Society; 2004:60-70
[75] Do H, Rothermel G. An empirical study of regression testing techniques incorporating context and lifetime factors and improved cost-benefit models. In: Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering. Portland, Oregon, USA:ACM; 2006:141-151
[76] Do H, Rothermel G. Using sensitivity analysis to create simplified economic models for regression testing. In:Proceedings of the 2008 international symposium on Software testing and analysis. Seattle, WA, USA:ACM; 2008:51-62
[77] Do H, Mirarab S, Tahvildari L et al. An empirical study of the effect of time constraints on the cost-benefits of regression testing. In:Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering. Atlanta, Georgia:ACM; 2008
[78] Garey MR, Johnson DS. Computers and Intractability:A Guide to the Theory of NP-Completeness:W. H. Freeman & Co. New York, NY, USA 1979
[79] Chvatal V. A Greedy Heuristic for the Set-Covering Problem[J]. MATHEMATICS OF OPERATIONS RESEARCH,1979,4(3):233-235
[80] Harrold MJ, Gupta R, Soffa ML. A methodology for controlling the size of a test suite[J], ACM Trans. Softw. Eng. Methodol.1993,2(3):270-285
[81] Chen TY, Lau MF. A new heuristic for test suite reduction[J]. Information and Software Technology,1998,40(5-6):347-354
[82] Tallam S, Gupta N. A concept analysis inspired greedy algorithm for test suite minimization. In:Proceedings of the 6th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering. Lisbon, Portugal:ACM; 2005:35-42
[83]游亮,卢炎生.测试用例集启发式约简算法分析与评价[J].计算机科学,2011,(12)
[84]马雪英,盛斌奎,叶澄清.用遗传算法的测试用例最小化[J].计算机科学,2007,(01)
[85] Mansour N, Fakih K. Natural Optimization Algorithms for Optimal Regression Testing. In:Proceedings of the 21st International Computer Software and Applications Conference:IEEE Computer Society; 1997:511-514
[86] Black J, Melachrinoudis E, Kaeli D. Bi-Criteria Models for All-Uses Test Suite Reduction. In:Proceedings of the 26th International Conference on Software Engineering:IEEE Computer Society; 2004:106-115
[87] Hsu H-Y, Orso A. MINTS:A general framework and tool for supporting test-suite minimization. In:Proceedings of the 2009 IEEE 31st International Conference on Software Engineering:IEEE Computer Society; 2009:419-429
[88] Zhang L, Hou S-S, Guo C et al. Time-aware test-case prioritization using integer linear programming. In:Proceedings of the eighteenth international symposium on Software testing and analysis. Chicago, IL, USA:ACM; 2009:213-224
[89] Wong WE, Horgan JR, London S et al. Effect of test set minimization on fault detection effectiveness. In:Proceedings of the 17th international conference on Software engineering. Seattle, Washington, United States:ACM; 1995:41-50
[90] Wong WE, Horgan JR, Mathur AP et al. Test set size minimization and fault detection effectiveness:a case study in a space application[J]. J. Syst. Softw,1999, 48(2):79-89
[91] Jeffrey D, Gupta N. Improving Fault Detection Capability by Selectively Retaining Test Cases during Test Suite Reduction[J]. Software Engineering, IEEE Transactions on,2007,33(2):108-123
[92] Yu Y, Jones JA, Harrold MJ. An empirical study of the effects of test-suite reduction on fault localization. In:Proceedings of the 30th international conference on Software engineering. Leipzig, Germany:ACM; 2008:201-210
[93]崔霞,高建华.一种新的测试集简化的测试覆盖准则[J].计算机科学,2009,(01)
[94] Rothermel G, Untch RH, Chengyun C et al. Prioritizing test cases for regression testing[J]. Software Engineering, IEEE Transactions on,2001,27(10):929-948
[95] Srivastava A, Thiagarajan J. Effectively prioritizing tests in development environment[J]. SIGSOFT Softw. Eng. Notes,2002,27(4):97-106
[2] Lindholm T, Yellin F. Java Virtual Machine Specification:Addison-Wesley Longman Publishing Co., Inc.; 1999
[3] Ryder BG, Tip F. Change impact analysis for object-oriented programs. In: Proceedings of the 2001 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering. Snowbird, Utah, United States:ACM; 2001
[4] Kung-Kiu L, Zheng W. Software Component Models[J]. Software Engineering, IEEE Transactions on,2007,33(10):709-724
[5] Harrold MJ. Testing:a roadmap. In:Proceedings of the Conference on The Future of Software Engineering. Limerick, Ireland:ACM; 2000
[6] Rehman MJ-u, Jabeen F, Bertolino A et al. Testing software components for integration:a survey of issues and techniques[J]. Software Testing, Verification and Reliability,2007,17(2):95-133
[7] Boehm B. A view of 20th and 21st century software engineering. In:Proceedings of the 28th international conference on Software engineering. Shanghai, China:ACM; 2006:12-29
[8] Saff D, Ernst MD. Continuous testing in eclipse. In:Proceedings of the 27th international conference on Software engineering. St. Louis, MO, USA:ACM; 2005:668-669
[9] Saff D, Ernst MD. An experimental evaluation of continuous testing during development. In:Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis. Boston, Massachusetts, USA:ACM; 2004:76-85
[10] Bertolino A. Software Testing Research:Achievements, Challenges, Dreams. In: 2007 Future of Software Engineering:IEEE Computer Society; 2007
[11] Yoo S, Harman M. Regression testing minimization, selection and prioritization:a survey[J]. Software Testing, Verification and Reliability,2010
[12] Zhu H, Hall PAV, May JHR. Software unit test coverage and adequacy[J]. ACM Comput. Surv,1997,29(4):366-427
[13] Engstrom E, Runeson P, Skoglund M. A systematic review on regression test selection techniques[J]. Information and Software Technology,2010,52(1):14-30
[14] Engstrom E, Skoglund M, Runeson P. Empirical evaluations of regression test selection techniques:a systematic review. In:Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement. Kaiserslautern, Germany:ACM; 2008:22-31
[15] Harrold MJ, Orso A. Retesting software during development and maintenance. In: Frontiers of Software Maintenance,2008. FoSM 2008.; 2008; 99-108
[16] Harrold MJ, Souffa ML. An incremental approach to unit testing during maintenance. In:Software Maintenance,1988., Proceedings of the Conference on; 1988 24-27 Oct 1988; 362-367
[17] Taha AB, Thebaut SM, Liu SS. An approach to software fault localization and revalidation based on incremental data flow analysis. In:Computer Software and Applications Conference,1989. COMPSAC 89., Proceedings of the 13th Annual International; 1989 20-22 Sep 1989; 527-534
[18] Laski J, Szermer W. Identification of program modifications and its applications in software maintenance. In:Software Maintenance,1992. Proceerdings., Conference on; 1992 9-12 Nov 1992; 282-290
[19] Vokolos FI, Frankl PG. Pythia:a regression test selection tool based on textual differencing. In:IFIP TC5 WG5.4 3rd internatinal conference on on Reliability, quality and safety of software-intensive systems. Athens, Greece:Chapman & Hall, Ltd. London, UK,1997:3-21
[20] Vokolos FI, Frankl PG. Empirical evaluation of the textual differencing regression testing technique. In:Software Maintenance,1998. Proceedings. International Conference on; 1998; 44-53
[21] Wong WE, Horgan JR, London S et al. A Study of Effective Regression Testing in Practice. In:Proceedings of the Eighth International Symposium on Software Reliability Engineering:IEEE Computer Society; 1997:264
[22] Leung HKN, White L. A study of integration testing and software regression at the integration level. In:Software Maintenance,1990., Proceedings., Conference on; 1990 26-29 Nov 1990; 290-301
[23] White LJ, Leung HKN. A firewall concept for both control-flow and data-flow in regression integration testing. In:Software Maintenance,1992. Proceerdings., Conference on; 1992; 262-271
[24] White L, Robinson B. Industrial Real-Time Regression Testing and Analysis Using Firewalls. In:Proceedings of the 20th IEEE International Conference on Software Maintenance:IEEE Computer Society; 2004
[25] Hartmann J, Robson DJ. Revalidation during the software maintenance phase. In: Software Maintenance,1989., Proceedings., Conference on; 1989 16-19 Oct 1989; 70-80
[26] Chen Y-F, Rosenblum DS, Vo K-P. TestTube:a system for selective regression testing. In:Proceedings of the 16th international conference on Software engineering. Sorrento, Italy:IEEE Computer Society Press; 1994
[27] Rothermel G, Harrold MJ. A safe, efficient algorithm for regression test selection. In: Software Maintenance,1993. CSM-93, Proceedings., Conference on; 1993 27-30 Sep 1993; 358-367
[28] Rothermel G, Harrold MJ. A framework for evaluating regression test selection techniques. In:Proceedings of the 16th international conference on Software engineering. Sorrento, Italy:IEEE Computer Society Press; 1994:201-210
[29] Rothermel G, Harrold MJ. Selecting tests and identifying test coverage requirements for modified software. In:Proceedings of the 1994 ACM SIGSOFT international symposium on Software testing and analysis. Seattle, Washington, United States: ACM; 1994:169-184
[30] Rothermel G. Efficient, effective regression testing using safe test selection techniques [Ph.D.]. United States--South Carolina:Clemson University; 1996
[31] Rothermel G, Harrold MJ. Analyzing regression test selection techniques[J]. Software Engineering, IEEE Transactions on,1996,22(8):529-551
[32] Rothermel G, Harrold MJ. A safe, efficient regression test selection technique[J]. ACM Trans. Softw. Eng. Methodol,1997,6(2):173-210
[33] Ball T. On the limit of control flow analysis for regression test selection. In: Proceedings of the 1998 ACM SIGSOFT international symposium on Software testing and analysis. Clearwater Beach, Florida, United States:ACM; 1998:134-142
[34] Bible J, Rothermel G, Rosenblum DS. A comparative study of coarse-and fine-grained safe regression test-selection techniques [J]. ACM Trans. Softw. Eng. Methodol,2001,10(2):149-183
[35] Kung D, Gao J, Hsia P et al. Developing an object-oriented software testing and maintenance environment[J]. Commun. ACM,1995,38(10):75-87
[36] White L, Jaber K, Robinson B. Utilization of extended firewall for object-oriented
regression testing. In:Software Maintenance,2005. ICSM'05. Proceedings of the 21st IEEE International Conference on; 200526-29 Sept.2005; 695-698
[37] White L, Jaber K, Robinson B et al. Extended firewall for regression testing:an experience report[J]. Journal of Software Maintenance and Evolution:Research and Practice,2008,20(6):419-433
[38] Ren X, Shah F, Tip F et al. Chianti:a tool for change impact analysis of Java programs. In:Proceedings of the 19th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Vancouver, BC, Canada:ACM; 2004:432-448
[39] Ren X. Change impact analysis for Java programs and applications [3319680]. United States-New Jersey:Rutgers The State University of New Jersey-New Brunswick; 2007
[40] Wloka J, Ryder B, Tip F et al. Safe-commit analysis to facilitate team software development. In:Proceedings of the 31st International Conference on Software Engineering:IEEE Computer Society; 2009:507-517
[41] Rothermel G, Harrold MJ, Dedhia J. Regression test selection for C++software[J]. Software Testing, Verification and Reliability,2000,10(2):77-109
[42] Harrold MJ, Jones JA, Li T et al. Regression test selection for Java software. In: Proceedings of the 16th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Tampa Bay, FL, USA:ACM; 2001
[43] Koju T, Takada S, Doi N. Regression Test Selection based on Intermediate Code for Virtual Machines. In:Proceedings of the International Conference on Software Maintenance:IEEE Computer Society; 2003
[44]方菲孙,王立福,杨芙清.面向对象软件回归测试技术研究[J].软件学报,2001,(03)
[45]顾玉良,周淑秋.面向对象程序回归测试策略研究[J].计算机科学,2000,(08)
[46] Hilsdale E, Hugunin J. Advice weaving in AspectJ. In:Proceedings of the 3rd international conference on Aspect-oriented software development. Lancaster, UK: ACM; 2004:26-35
[47] Zhao J, Xie T, Li N. Towards regression test selection for AspectJ programs. In: Proceedings of the 2nd workshop on Testing aspect-oriented programs. Portland, Maine:ACM; 2006:21-26
[48] Xu G, Rountev A. Regression Test Selection for AspectJ Software. In:Proceedings
of the 29th international conference on Software Engineering:IEEE Computer Society; 2007:65-74
[49] Mahdian A, Andrews AA, Pilskalns OJ. Regression testing with UML software designs:A survey[J]. Journal of Software Maintenance and Evolution:Research and Practice,2009,21(4):253-286
[50] Briand LC, Labiche Y, He S. Automating regression test selection based on UML designs[J]. Inf. Softw. Technol,2009,51(1):16-30
[51] Chen Y, Probert RL, Ural H. Regression test suite reduction based on SDL models of system requirements [J]. Journal of Software Maintenance and Evolution:Research and Practice,2009,21(6):379-405
[52] Zheng J. In regression testing selection when source code is not available. In: Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering. Long Beach, CA, USA:ACM; 2005:752-755
[53] Zheng J, Robinson B, Williams L et al. Applying regression test selection for COTS-based applications. In:Proceedings of the 28th international conference on Software engineering. Shanghai, China:ACM; 2006
[54] Zheng J, Williams L, Robinson B. Pallino:automation to support regression test selection for cots-based applications. In:Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering. Atlanta, Georgia, USA:ACM; 2007
[55] Zheng J. In regression testing without code [Ph.D.]. United States-North Carolina: North Carolina State University; 2007
[56] Orso A, Harrold MJ, Rosenblum D et al. Using component metacontent to support the regression testing of component-based software. In:Software Maintenance,2001. Proceedings. IEEE International Conference on; 2001; 716-725
[57] Orso A, Do H, Rothermel G et al. Using component metadata to regression test component-based software[J]. Software Testing, Verification and Reliability,2007, 17(2):61-94
[58]毛澄映,卢炎生.构件软件回归测试用例选择策略[J].计算机研究与发展,2006,(10)
[59]马良荔,郭福亮,李永杰.基于变更模型的元数据在构件回归测试中的应用研究[J].计算机科学,2008,(05)
[60] Tichy WF. Smart recompilation[J]. ACM Trans. Program. Lang. Syst,1986,8(3):
273-291
[61] Schwanke RW, Kaiser GE. Smarter recompilation[J]. ACM Trans. Program. Lang. Syst,1988,10(4):627-632
[62] Drossopoulou S, Eisenbach S, Wragg D. A Fragment Calculus Towards a Model of Separate Compilation, Linking and Binary Compatibility. In:Proceedings of the 14th Annual IEEE Symposium on Logic in Computer Science:IEEE Computer Society; 1999:147
[63]Dmitriev M. Language-specific make technology for the Java programming language. In:Proceedings of the 17th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Seattle, Washington, USA: ACM; 2002:373-385
[64] Forman IR, Conner MH, Danforth SH et al. Release-to-release binary compatibility in SOM. In:Proceedings of the tenth annual conference on Object-oriented programming systems, languages, and applications. Austin, Texas, United States: ACM; 1995:426-438
[65] Gosling J, Joy B, Steele G et al. The Java Language Specification, Third Edition.3 ed:Addison Wesley; 2005
[66] Drossopoulou S, Wragg D, Eisenbach S. What is Java binary compatibility? In: Proceedings of the 13th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. Vancouver, British Columbia, Canada:ACM; 1998:341-361
[67] Graves TL, Harrold MJ, Kim J et al. An empirical study of regression test selection techniques. In:Software Engineering,1998. Proceedings of the 1998 International Conference on; 1998 19-25 Apr 1998; 188-197
[68] Graves TL, Harrold MJ, Kim J-M et al. An empirical study of regression test selection techniques [J]. ACM Trans. Softw. Eng. Methodol,2001,10(2):184-208
[69] Kim J-M, Porter A, Rothermel G. An empirical study of regression test application frequency[J]. Software Testing, Verification and Reliability,2005,15(4):257-279
[70] Rothermel G, Elbaum S, Malishevsky A et al. The impact of test suite granularity on the cost-effectiveness of regression testing. In:Proceedings of the 24th International Conference on Software Engineering. Orlando, Florida:ACM; 2002:130-140
[71] Rothermel G, Elbaum S, Malishevsky AG et al. On test suite composition and cost-effective regression testing[J]. ACM Trans. Softw. Eng. Methodol,2004,13(3): 277-331
[72] Rothermel G, Harrold MJ, Ostrin J et al. An Empirical Study of the Effects of Minimization on the Fault Detection Capabilities of Test Suites. In:Proceedings of the International Conference on Software Maintenance:IEEE Computer Society; 1998:34
[73] Do H. Accounting for context and lifetime factors:A new approach for evaluating regression testing techniques [Ph.D.]. United States-Nebraska:The University of Nebraska-Lincoln; 2007
[74] Do H, Elbaum S, Rothermel G. Infrastructure Support for Controlled Experimentation with Software Testing and Regression Testing Techniques. In: Proceedings of the 2004 International Symposium on Empirical Software Engineering:IEEE Computer Society; 2004:60-70
[75] Do H, Rothermel G. An empirical study of regression testing techniques incorporating context and lifetime factors and improved cost-benefit models. In: Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering. Portland, Oregon, USA:ACM; 2006:141-151
[76] Do H, Rothermel G. Using sensitivity analysis to create simplified economic models for regression testing. In:Proceedings of the 2008 international symposium on Software testing and analysis. Seattle, WA, USA:ACM; 2008:51-62
[77] Do H, Mirarab S, Tahvildari L et al. An empirical study of the effect of time constraints on the cost-benefits of regression testing. In:Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering. Atlanta, Georgia:ACM; 2008
[78] Garey MR, Johnson DS. Computers and Intractability:A Guide to the Theory of NP-Completeness:W. H. Freeman & Co. New York, NY, USA 1979
[79] Chvatal V. A Greedy Heuristic for the Set-Covering Problem[J]. MATHEMATICS OF OPERATIONS RESEARCH,1979,4(3):233-235
[80] Harrold MJ, Gupta R, Soffa ML. A methodology for controlling the size of a test suite[J], ACM Trans. Softw. Eng. Methodol.1993,2(3):270-285
[81] Chen TY, Lau MF. A new heuristic for test suite reduction[J]. Information and Software Technology,1998,40(5-6):347-354
[82] Tallam S, Gupta N. A concept analysis inspired greedy algorithm for test suite minimization. In:Proceedings of the 6th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering. Lisbon, Portugal:ACM; 2005:35-42
[83]游亮,卢炎生.测试用例集启发式约简算法分析与评价[J].计算机科学,2011,(12)
[84]马雪英,盛斌奎,叶澄清.用遗传算法的测试用例最小化[J].计算机科学,2007,(01)
[85] Mansour N, Fakih K. Natural Optimization Algorithms for Optimal Regression Testing. In:Proceedings of the 21st International Computer Software and Applications Conference:IEEE Computer Society; 1997:511-514
[86] Black J, Melachrinoudis E, Kaeli D. Bi-Criteria Models for All-Uses Test Suite Reduction. In:Proceedings of the 26th International Conference on Software Engineering:IEEE Computer Society; 2004:106-115
[87] Hsu H-Y, Orso A. MINTS:A general framework and tool for supporting test-suite minimization. In:Proceedings of the 2009 IEEE 31st International Conference on Software Engineering:IEEE Computer Society; 2009:419-429
[88] Zhang L, Hou S-S, Guo C et al. Time-aware test-case prioritization using integer linear programming. In:Proceedings of the eighteenth international symposium on Software testing and analysis. Chicago, IL, USA:ACM; 2009:213-224
[89] Wong WE, Horgan JR, London S et al. Effect of test set minimization on fault detection effectiveness. In:Proceedings of the 17th international conference on Software engineering. Seattle, Washington, United States:ACM; 1995:41-50
[90] Wong WE, Horgan JR, Mathur AP et al. Test set size minimization and fault detection effectiveness:a case study in a space application[J]. J. Syst. Softw,1999, 48(2):79-89
[91] Jeffrey D, Gupta N. Improving Fault Detection Capability by Selectively Retaining Test Cases during Test Suite Reduction[J]. Software Engineering, IEEE Transactions on,2007,33(2):108-123
[92] Yu Y, Jones JA, Harrold MJ. An empirical study of the effects of test-suite reduction on fault localization. In:Proceedings of the 30th international conference on Software engineering. Leipzig, Germany:ACM; 2008:201-210
[93]崔霞,高建华.一种新的测试集简化的测试覆盖准则[J].计算机科学,2009,(01)
[94] Rothermel G, Untch RH, Chengyun C et al. Prioritizing test cases for regression testing[J]. Software Engineering, IEEE Transactions on,2001,27(10):929-948
[95] Srivastava A, Thiagarajan J. Effectively prioritizing tests in development environment[J]. SIGSOFT Softw. Eng. Notes,2002,27(4):97-106