面向WS-BPEL程序的变异测试优化技术
|
摘要
WS-BPEL(business process execution language for Web service)是一种基于XML的、面向过程的可执行服务组装语言.由于Web服务的动态性、松耦合特性、部署与运行于开放的网络环境,如何保证WS-BPEL程序的可靠性尤显重要.尽管变异测试具有较强的故障检测能力,但由于变异体数量大、执行时间长、计算开销大,不利于在实践中广泛应用.为了增强变异测试的实用性,针对如何降低面向WS-BPEL程序的变异测试开销问题,从二阶变异和变异算子优先级角度提出了2种面向WS-BPEL程序的变异测试优化技术,开发了相应的集成化支持工具μBPEL.使用6个WS-BPEL程序实例对提出的优化技术的有效性进行验证.实验结果表明:提出的优化技术可以有效地减少变异体数目而并不显著降低变异测试有效性,提高了变异测试的效率.
Business process execution language for Web service(WS-BPEL) is an executable XML-based and process-oriented service composition language. Due to unique features of Web services, such as dynamics, loose coupling, and open deployment and execution environment, it is an important issue how to assure the quality of WS-BPEL programs. Although mutation testing has a strong fault detection capability, it fails to be widely practiced due to the large number of mutants, the long execution period, and the high computation cost. In order to improve the practicability of mutation testing, we investigate how to decrease the cost of mutation testing for WS-BPEL programs, and propose two kinds of optimization techniques from the perspectives of second-order mutation and prioritization of operators. We also develop an integrated tool named μBPEL to support the mutant generation, optimization, and execution of the proposed optimization techniques. Finally, an empirical study has been conducted where six representative WS-BPEL programs are used to validate and evaluate the effectiveness of the proposed optimized mutation testing techniques. Experimental results show that the proposed optimization techniques for WS-BPEL programs are able to reduce the number of mutants without significantly jeopardizing their fault detection effectiveness and thus improve the efficiency of mutation testing.
Business process execution language for Web service(WS-BPEL) is an executable XML-based and process-oriented service composition language. Due to unique features of Web services, such as dynamics, loose coupling, and open deployment and execution environment, it is an important issue how to assure the quality of WS-BPEL programs. Although mutation testing has a strong fault detection capability, it fails to be widely practiced due to the large number of mutants, the long execution period, and the high computation cost. In order to improve the practicability of mutation testing, we investigate how to decrease the cost of mutation testing for WS-BPEL programs, and propose two kinds of optimization techniques from the perspectives of second-order mutation and prioritization of operators. We also develop an integrated tool named μBPEL to support the mutant generation, optimization, and execution of the proposed optimization techniques. Finally, an empirical study has been conducted where six representative WS-BPEL programs are used to validate and evaluate the effectiveness of the proposed optimized mutation testing techniques. Experimental results show that the proposed optimization techniques for WS-BPEL programs are able to reduce the number of mutants without significantly jeopardizing their fault detection effectiveness and thus improve the efficiency of mutation testing.
引文
[1]Papazoglou M P,Traverso P,Dustdar S,et al.Serviceoriented computing:A research roadmap[J].International Journal on Cooperative Information Systems,2008,17(2):223-255
[2]Eviware.Web services business process execution language[OL].2012[2017-06-11].http://docs.oasis-open.org/wsbpel/2.0/OS/wsbpel-v 2.0-OS.html
[3]Sun Chang’ai.On open issues on SOA-based software development[OL].2011[2017-06-11].http://www.paper.edu.cn/releasepaper/content/201107-461(in Chinese)(孙昌爱.SOA软件开发中的若干开放问题探讨[OL].2011[2017-06-11].http://www.paper.edu.cn/releasepaper/content/201107-461)
[4]DeMillo R A,Lipton R J,Sayward F G.Hints on test data selection:Help for the practicing programmer[J].Computer,1978,11(4):34-41
[5]Chen Xiang,Gu Qing.Mutation testing:Principal,optimization and application[J].Journal of Frontiers of Computer Science and Technology,2012,6(12):1057-1075(in Chinese)(陈翔,顾庆.变异测试:原理、优化和应用[J].计算机科学与探索,2012,6(12):1057-1075)
[6]Estero-Botaro A,Palomo-Lozano F,Medina-Bulo I.Mutation operators for WS-BPEL 2.0[OL].2008[2016-06-10].https://www.researchgate.net/publication/255992637_Mutation_operators_for_WS-BPEL_20
[7]Estero-Botaro A,Palomo-Lozano F,Medina-Bulo I.Quantitative evaluation of mutation operators for WS-BPELcompositions[C]//Proc of the 3rd Int Conf on Software Testing,Verification,and Validation Workshops(ICSTW).Los Angeles,CA:IEEE Computer Society,2010:142-150
[8]Wang Qiaoling.Research on mutation testing technique for BPEL programs and its supporting tool[D].Beijing:University of Science and Technology Beijing,2015(in Chinese)(王巧玲.面向BPEL程序的变异测试技术与支持工具研究[D].北京:北京科技大学,2015)
[9]Pan Lin.Research on optimization techniques of mutation testing for BPEL programs and their supporting tool[D].Beijing:University of Science and Technology Beijing,2017(in Chinese)(潘琳.BPEL程序的变异测试优化技术与集成化支持工具研究[D].北京:北京科技大学,2017)
[10]Sun Chang’ai,Pan Lin,Wang Qiaoling,et al.An empirical study on mutation testing of WS-BPEL programs[J].The Computer Journal,2017,60(1):143-158
[11]Just R,Jalali D,Inozemtseva L,et al.Are mutants a valid substitute for real faults in software testing?[C]//Proc of the 22nd Symp on the Foundations of Software Engineering(FSE’14).New York:ACM,2014:654-665
[12]Mathur A P,Wong W E.An empirical comparison of data flow and mutation-based test adequacy criteria[J].Software Testing,Verification and Reliability,1994,4(1):9-31
[13]King K N,Offutt A J.A FORTRAN language system for mutation-based software testing[J].Software:Practice and Experience,1991,21(7):685-718
[14]Offutt A J,Rothermel G,Zapf C.An experimental evaluation of selective mutation[C]//Proc of the 15th Int Conf on Software Engineering(ICSE’93).Los Angeles,CA:IEEE Computer Society,1993:100-107
[15]Hussain S.Mutation clustering[D].London,UK:King’s College London,2008
[16]Langdon W B,Harman M,Jia Yue.Efficient multi-objective higher order mutation testing with genetic programming[J].Journal of Systems and Software,2010,83(12):2416-2430
[17]Sun Chang’ai,Xue Feifei,Liu Huai,et al.A path-aware approach to mutant reduction in mutation testing[J].Information and Software Technology,2016,81(1):65-81
[18]Krauser E W,Mathur A P,Rego V J.High performance software testing on SIMD machines[J].IEEE Transactions on Software Engineering,1991,17(5):403-423
[19]Sun Chang’ai,Zhai Yimeng,Shang Yan,et al.BPELDebugger:An effective BPEL-specific fault localization framework[J].Information and Software Technology,2013,55(12):2140-2153
[20]Mou Xiaoling.Research of Web service composition test based on extended colored Petri net[D].Chongqing:Southwest University,2012(in Chinese)(牟小玲.基于扩展着色Petri网的服务组合测试研究[D].重庆:西南大学,2012)
[21]Sun Chang’ai,Zhao Yan,Pan Lin,et al.Automated testing of WS-BPEL service compositions:A scenario-oriented approach[J].IEEE Transactions on Services Computing,2018,11(4):616-629
[22]Zhao Yan.A scenario-based approach to automatic test case generation for BPEL programs and its supporting tool[D].Beijing:University of Science and Technology Beijing,2014(in Chinese)(赵彦.基于场景的BPEL测试用例自动生成技术与工具研究[D].北京:北京科技大学,2014)
[23]Lee S C,Offutt J.Generating test cases for XML-based Web component interactions using mutation analysis[C]//Proc of the 12th Int Symp on Software Reliability Engineering(ISSRE’01).Los Angeles,CA:IEEE Computer Society,2001:200-209
[24]Boonyakulsrirung P,Suwannasart T.A weak mutation testing framework for WS-BPEL[C]//Proc of the 8th Int Joint Conf on Computer Science and Software Engineering(JCSSE’11).Piscataway Township,NJ:IEEE,2011:313-318
[25]Domínguez-Jiménez J J,Estero-Botaro A,García-Domínguez A,et al.GAmera:An automatic mutant generation system for WS-BPEL compositions[C]//Proc of the 7th European Conf on Web Services(ECOWS’09).Los Alamitos,CA:IEEE Computer Society,2009:97-106
[26]Boonyakulsrirung P,Suwannasart T.WeMuTe-A weak mutation testing tool for WS-BPEL[C]//Proc of the Int MultiConference of Engineers and Computer Scientists(IMECS’12).Hong Kong:Newswood Limited,2012:810-815
[27]Polo M,Piattini M,García-Rodríguez I.Decreasing the cost of mutation testing with second-order mutants[J].Software Testing,Verification and Reliability,2009,19(2):111-131
[28]Sun Chang’ai,Khoury E,Aiello M.Transaction management in service-oriented systems:Requirements and a proposal[J].IEEE Transactions on Services Computing,2011,4(2):167-180
[29]Elbaum S,Malishevs A G,Rothermel G.Test case prioritization:A family of empirical studies[J].IEEE Transactions on Software Engineering,2002,28(10):159-182
[30]Myers G J.The Art of Software Testing[M].2nd ed.Hoboken,NJ:John Wiley and Sons,2004
① http://www.activevos.com/developers/sample-apps
[2]Eviware.Web services business process execution language[OL].2012[2017-06-11].http://docs.oasis-open.org/wsbpel/2.0/OS/wsbpel-v 2.0-OS.html
[3]Sun Chang’ai.On open issues on SOA-based software development[OL].2011[2017-06-11].http://www.paper.edu.cn/releasepaper/content/201107-461(in Chinese)(孙昌爱.SOA软件开发中的若干开放问题探讨[OL].2011[2017-06-11].http://www.paper.edu.cn/releasepaper/content/201107-461)
[4]DeMillo R A,Lipton R J,Sayward F G.Hints on test data selection:Help for the practicing programmer[J].Computer,1978,11(4):34-41
[5]Chen Xiang,Gu Qing.Mutation testing:Principal,optimization and application[J].Journal of Frontiers of Computer Science and Technology,2012,6(12):1057-1075(in Chinese)(陈翔,顾庆.变异测试:原理、优化和应用[J].计算机科学与探索,2012,6(12):1057-1075)
[6]Estero-Botaro A,Palomo-Lozano F,Medina-Bulo I.Mutation operators for WS-BPEL 2.0[OL].2008[2016-06-10].https://www.researchgate.net/publication/255992637_Mutation_operators_for_WS-BPEL_20
[7]Estero-Botaro A,Palomo-Lozano F,Medina-Bulo I.Quantitative evaluation of mutation operators for WS-BPELcompositions[C]//Proc of the 3rd Int Conf on Software Testing,Verification,and Validation Workshops(ICSTW).Los Angeles,CA:IEEE Computer Society,2010:142-150
[8]Wang Qiaoling.Research on mutation testing technique for BPEL programs and its supporting tool[D].Beijing:University of Science and Technology Beijing,2015(in Chinese)(王巧玲.面向BPEL程序的变异测试技术与支持工具研究[D].北京:北京科技大学,2015)
[9]Pan Lin.Research on optimization techniques of mutation testing for BPEL programs and their supporting tool[D].Beijing:University of Science and Technology Beijing,2017(in Chinese)(潘琳.BPEL程序的变异测试优化技术与集成化支持工具研究[D].北京:北京科技大学,2017)
[10]Sun Chang’ai,Pan Lin,Wang Qiaoling,et al.An empirical study on mutation testing of WS-BPEL programs[J].The Computer Journal,2017,60(1):143-158
[11]Just R,Jalali D,Inozemtseva L,et al.Are mutants a valid substitute for real faults in software testing?[C]//Proc of the 22nd Symp on the Foundations of Software Engineering(FSE’14).New York:ACM,2014:654-665
[12]Mathur A P,Wong W E.An empirical comparison of data flow and mutation-based test adequacy criteria[J].Software Testing,Verification and Reliability,1994,4(1):9-31
[13]King K N,Offutt A J.A FORTRAN language system for mutation-based software testing[J].Software:Practice and Experience,1991,21(7):685-718
[14]Offutt A J,Rothermel G,Zapf C.An experimental evaluation of selective mutation[C]//Proc of the 15th Int Conf on Software Engineering(ICSE’93).Los Angeles,CA:IEEE Computer Society,1993:100-107
[15]Hussain S.Mutation clustering[D].London,UK:King’s College London,2008
[16]Langdon W B,Harman M,Jia Yue.Efficient multi-objective higher order mutation testing with genetic programming[J].Journal of Systems and Software,2010,83(12):2416-2430
[17]Sun Chang’ai,Xue Feifei,Liu Huai,et al.A path-aware approach to mutant reduction in mutation testing[J].Information and Software Technology,2016,81(1):65-81
[18]Krauser E W,Mathur A P,Rego V J.High performance software testing on SIMD machines[J].IEEE Transactions on Software Engineering,1991,17(5):403-423
[19]Sun Chang’ai,Zhai Yimeng,Shang Yan,et al.BPELDebugger:An effective BPEL-specific fault localization framework[J].Information and Software Technology,2013,55(12):2140-2153
[20]Mou Xiaoling.Research of Web service composition test based on extended colored Petri net[D].Chongqing:Southwest University,2012(in Chinese)(牟小玲.基于扩展着色Petri网的服务组合测试研究[D].重庆:西南大学,2012)
[21]Sun Chang’ai,Zhao Yan,Pan Lin,et al.Automated testing of WS-BPEL service compositions:A scenario-oriented approach[J].IEEE Transactions on Services Computing,2018,11(4):616-629
[22]Zhao Yan.A scenario-based approach to automatic test case generation for BPEL programs and its supporting tool[D].Beijing:University of Science and Technology Beijing,2014(in Chinese)(赵彦.基于场景的BPEL测试用例自动生成技术与工具研究[D].北京:北京科技大学,2014)
[23]Lee S C,Offutt J.Generating test cases for XML-based Web component interactions using mutation analysis[C]//Proc of the 12th Int Symp on Software Reliability Engineering(ISSRE’01).Los Angeles,CA:IEEE Computer Society,2001:200-209
[24]Boonyakulsrirung P,Suwannasart T.A weak mutation testing framework for WS-BPEL[C]//Proc of the 8th Int Joint Conf on Computer Science and Software Engineering(JCSSE’11).Piscataway Township,NJ:IEEE,2011:313-318
[25]Domínguez-Jiménez J J,Estero-Botaro A,García-Domínguez A,et al.GAmera:An automatic mutant generation system for WS-BPEL compositions[C]//Proc of the 7th European Conf on Web Services(ECOWS’09).Los Alamitos,CA:IEEE Computer Society,2009:97-106
[26]Boonyakulsrirung P,Suwannasart T.WeMuTe-A weak mutation testing tool for WS-BPEL[C]//Proc of the Int MultiConference of Engineers and Computer Scientists(IMECS’12).Hong Kong:Newswood Limited,2012:810-815
[27]Polo M,Piattini M,García-Rodríguez I.Decreasing the cost of mutation testing with second-order mutants[J].Software Testing,Verification and Reliability,2009,19(2):111-131
[28]Sun Chang’ai,Khoury E,Aiello M.Transaction management in service-oriented systems:Requirements and a proposal[J].IEEE Transactions on Services Computing,2011,4(2):167-180
[29]Elbaum S,Malishevs A G,Rothermel G.Test case prioritization:A family of empirical studies[J].IEEE Transactions on Software Engineering,2002,28(10):159-182
[30]Myers G J.The Art of Software Testing[M].2nd ed.Hoboken,NJ:John Wiley and Sons,2004
① http://www.activevos.com/developers/sample-apps