基于应用仿真的存储性能测试工具的研究和实现
|
摘要
随着通信技术、计算技术的飞速发展,企业需求日益扩大,信息数据的总量呈爆炸式增长趋势的同时数据的形式也呈现多样化,这必然对设备的存储能力提出了越来越高的要求,存储产品的性能已然成为商家关注的重点,高效和高置信度的存储性能测试工具已经成为研究热点。
存储产品的性能不仅体现在出厂时的常规性能指标,如吞吐量、响应时间、支持并发数等,存储设备在真实应用场景下的性能表现更能体现一款产品的核心竞争力。存储设备的性能测试是测试过程中的一个重要环节,合适且置信度高的性能测试工具是存储产品研发过程和产品采购过程所迫切需要的。然而,当前业界存在的一些存储性能测试工具存在一些缺陷,如测试代价昂贵、应用场景有限以及用户体验差等问题。
基于以上原因,本文研究并实现了一款通过模拟存储产品的应用场景来对存储进行应用仿真测试的性能测试工具。该工具的测试对象包括DAS(Direct Attached Storage,直连式存储)、NAS(Network Attached Storage,网络附加存储)、SAN(Storage Area Network,存储区域网络)等存储系统,能够模拟的业务场景有普通文件的访问业务、VOD(Video On Demand,在线视频点播)业务、IPTV(Internet Protocol Television,网络电视)业务、NVS(Network Video Supervision,网络视频监控)业务。该工具通过模拟用户在这些场景中对存储的访问模式和IO操作方式对存储进行测试,这样就无需搭建真实的业务平台,可以节省大量的人力和物力。
本文在研究主流性能测试工具的工作原理和架构的基础上,采用了自治组件架构进行系统设计。论文在一款实现了自治组件架构的框架(Jsim框架)下搭建系统总体框架并制定了组件间的通信流程。并完成了系统的模块设计。在整个系统设计完成之后,经过大量的检验以及置信度评估工作,证明该工具具有易用性、可扩展性、用户体验性好、高置信度等特点,并在实际工程中得到了应用。
The equipment was required more and more high storage capacity, with the rapid development of communication and computing technology in recent years. The type of data becomes diversification when the total amount of information data becomes exploding growth. The performance of storage products has become the focus attention of the business.The storage performance testing tools which achieve efficient and high confidence level have become a hotspot of research.
The performance of the storage products is embodied less in the factory routine performance indicators, such as throughput, response time, concurrent supported, etc. the core competitiveness embodied more when performance under the specific applications. The performance testing of storage is an important part of the test process, appropriate performance testing tool with high degree of confidence is the urgent need for storage product development process and product procurement process. However, the current existing performance testing tools in the industry have some deficiencies, such as high cost of testing, distortion of testing result, limited scenarios, bad feedback from the clients, etc.
Due to these reasons above, this thesis designs and implements a performance testing tool which can make applied simulation testing to the storage through simulating various scenarios of storage. The test objects of the tool include DAS (Direct Attached Storage), NAS (Attached Storage Network), SAN (Storage Area Network) storage system, and the scenarios it can simulate include ordinary file access operations, VOD (Video on Demand Online) business, IPTV (Internet TV) business and NVS (Network Video Monitoring) business. The tool can test the storage by simulating the users’access patterns and IO operation mode. So this can save a lot of manpower and material resources without building real business platform.
The thesis uses autonomous component architecture for system design Based on the research of working principle and architecture of the mainstream performance testing tools. The thesis builds the system framework and develops a communication flow between components under the Jsim framework which has implemented ACA framework. And the thesis has complemented the design of each modules of the system. A lot of experiments and confidence assessments have done base on the completed system. Practice has proved that the tool has the characteristics of usability, scalability, great user experience, high confidence and so on. Meanwhile, the tool has been applied in practical projects.
存储产品的性能不仅体现在出厂时的常规性能指标,如吞吐量、响应时间、支持并发数等,存储设备在真实应用场景下的性能表现更能体现一款产品的核心竞争力。存储设备的性能测试是测试过程中的一个重要环节,合适且置信度高的性能测试工具是存储产品研发过程和产品采购过程所迫切需要的。然而,当前业界存在的一些存储性能测试工具存在一些缺陷,如测试代价昂贵、应用场景有限以及用户体验差等问题。
基于以上原因,本文研究并实现了一款通过模拟存储产品的应用场景来对存储进行应用仿真测试的性能测试工具。该工具的测试对象包括DAS(Direct Attached Storage,直连式存储)、NAS(Network Attached Storage,网络附加存储)、SAN(Storage Area Network,存储区域网络)等存储系统,能够模拟的业务场景有普通文件的访问业务、VOD(Video On Demand,在线视频点播)业务、IPTV(Internet Protocol Television,网络电视)业务、NVS(Network Video Supervision,网络视频监控)业务。该工具通过模拟用户在这些场景中对存储的访问模式和IO操作方式对存储进行测试,这样就无需搭建真实的业务平台,可以节省大量的人力和物力。
本文在研究主流性能测试工具的工作原理和架构的基础上,采用了自治组件架构进行系统设计。论文在一款实现了自治组件架构的框架(Jsim框架)下搭建系统总体框架并制定了组件间的通信流程。并完成了系统的模块设计。在整个系统设计完成之后,经过大量的检验以及置信度评估工作,证明该工具具有易用性、可扩展性、用户体验性好、高置信度等特点,并在实际工程中得到了应用。
The equipment was required more and more high storage capacity, with the rapid development of communication and computing technology in recent years. The type of data becomes diversification when the total amount of information data becomes exploding growth. The performance of storage products has become the focus attention of the business.The storage performance testing tools which achieve efficient and high confidence level have become a hotspot of research.
The performance of the storage products is embodied less in the factory routine performance indicators, such as throughput, response time, concurrent supported, etc. the core competitiveness embodied more when performance under the specific applications. The performance testing of storage is an important part of the test process, appropriate performance testing tool with high degree of confidence is the urgent need for storage product development process and product procurement process. However, the current existing performance testing tools in the industry have some deficiencies, such as high cost of testing, distortion of testing result, limited scenarios, bad feedback from the clients, etc.
Due to these reasons above, this thesis designs and implements a performance testing tool which can make applied simulation testing to the storage through simulating various scenarios of storage. The test objects of the tool include DAS (Direct Attached Storage), NAS (Attached Storage Network), SAN (Storage Area Network) storage system, and the scenarios it can simulate include ordinary file access operations, VOD (Video on Demand Online) business, IPTV (Internet TV) business and NVS (Network Video Monitoring) business. The tool can test the storage by simulating the users’access patterns and IO operation mode. So this can save a lot of manpower and material resources without building real business platform.
The thesis uses autonomous component architecture for system design Based on the research of working principle and architecture of the mainstream performance testing tools. The thesis builds the system framework and develops a communication flow between components under the Jsim framework which has implemented ACA framework. And the thesis has complemented the design of each modules of the system. A lot of experiments and confidence assessments have done base on the completed system. Practice has proved that the tool has the characteristics of usability, scalability, great user experience, high confidence and so on. Meanwhile, the tool has been applied in practical projects.
引文
[1]周敬利,余胜生等.网络存储原理与技术[M].清华大学出版社,2003:17-32.
[2]张冬.大话存储——网络存储系统原理精解与最佳实践[M].北京:清华大学出版社,2008.
[3]段念.软件性能测试过程详解与案例剖析.北京:清华大学出版社,2006
[4]柳胜.性能测试从零开始[M].北京:电子工业出版社,2008:35-222.
[5]性能测试[EB/OL].http://baike.baidu.com/view/106187.html?wtp=tt,2005
[6]刘苗苗,Web性能测试的方法研究与工具实现,[学位论文],西安理工大学,2007
[7]付长东,舒继武,沈美明,郑纬民,网络存储性能基准的研究、评价与发展[J].小型微型计算机系统,2004,(25)12
[8]杨进,魏轶伟,贾惠波,李栋.存储区域网的性能测试[J].计算机工程,2003,(29)16
[9]马跃,李祥,基于TPC-C标准的数据库基准性能测试工具的研究和实现,[学位论文],贵州大学,2006
[10]干戈,王欣晖,王国仁,单吉第.TPC-C测试标准及其在面向对象数据库上的设计与实现[J].计算机科学,1998,(25)3
[11]王良,杨政,粟跃鹏.TPC-H分析与测试工具设计[J].计算机工程与应用,2007,43(3)
[12]邵芬,于国防,付海燕, AB:一种简单的性能测试工具[J].计算机时代,2007.12
[13]郝炜,性能测试工具LoadRunner介绍[A].计算机工程应用技术,2008
[14]朱怡雯钱超林勇,软件性能测试工具综述,FINANCIAL COMPUTER OF CHINA,2009,(7)
[15]赵燕君,Web结构软件性能测试工具的设计与实现.计算机工程与应用,2004
[16]朱敏,解群,性能测试工具的研究与设计.开发研究与设计技术,2005
[17]丁秀兰,崔冬华,Web测试中性能测试工具的研究与应用. [学位论文],太原理工大学,2008
[18]张静力,戴龙,陈继努,SAN存储技术在IPTV中的应用[J].中国有线电视,2006.
[19] Dustin Dustin Elfriede.软件自动化测试[Z].电子工业出版社,2003
[20]张建国,测试软件自动化生成环境的研究及其在相控雷达测试中的应用,[学位论文],电子科技大学,1997
[21] Tan, C.W., Siu, Y.M., Lee, K.K., Chan, Y.C., Cheng, L.M, Fabrication of smart card using UV curable anisotropic conductive adhesive (ACA) part II: reliability performance of the ACA joints,[C] Business of Electronic Product Reliabilityand Liability, 2004
[22] Zhao Gang, Chen Wenbing, Solving the Tramp Ship Dispatching Problem Using ACA[C], 26th Chinese Control Conference, 2007
[23] The Autonomous Component Architecture [EB/OL]. http://j-sim.cs.uiuc.edu/whitepaper/aca.thml,2006
[24] Ahmed Sobeih, Mahesh Viswanathan, Darko Marinov, Jennifer C. Hou. J-sim: An Integrated Environment for Simulation and Model Checking of Network Protocols [J]. IEEE Software, 2007.
[25] Ahmed Sobeih, Wei-Peng Chen, Jennifer C. Hou, Lu-Chuan Kung.A Simulation and Emulation Environment for Wireless Sensor Networks[z]. IEEE Software, 2006.
[26] Miller, J.A., Nair, R.S. JSIM: A Java-based simulation and animation environment, Simulation Symposium [C], 1997
[27] Hung-ying Tyan, Ahmed Sobih Jennifer C. Hou. Design, Realization and Evaluation of a Component-based, Compositional Network Simulation Environment[R]. SIMULATION, 2009
[28] J-Sim INET Tutorial [EB/OL]. http://j-sim.cs.uiuc.edu/drcl.inet/inet_tutorial.html,2003
[29] Tutorial-Working with J-sim [EB/OL]. http://j-sim.cs.uiuc.edu/tutorial/jsim_tutorial.html, 2003.
[30] Ns-2[EB/OL]. http://www.isi.edu/nsnam/ns/.2005
[31] Grenford J.Myers. The Art of Software Testing [M].John Wiley&Sons, 1979:4-18.
[32] Eric Freeman.Head First - Design Patterns[M].中国电力出版社,2007.
[33] Robert Spalding. Storage Networks: The Complete Reference[M].电子工业出版社2004:24-195.
[34] Richard Barker, Paul Massiglia. Storage Area Network Essentials[M].电子工业出版社,2004:17-118.
[35]李雅红.基于J-sim的主动节点内存资源管理[J].计算机工程与设计,2009.
[36]李雅红.基于J-sim的主动节点资源访问控制策略实现[J].微电子学与计算机,2009,
[37]李致远,闵林,毕俊蕾.基于J-sim的网络仿真分析与设计[J].计算机仿真,2007,(24)7.
[38]李捷,李致远.基于J-sim的移动代理网络仿真研究[J].河南大学学报,2008,38)1.
[39]佐丹.基于纯XML数据库Natix系统存储技术研究[D].哈尔滨工业大学, 2009
[40]竺明琴.浅析离散事件系统仿真描述模型的一般过程[J].七一六所科技学报,1997.
[41]傅厚荃,包小源,xml文件压缩存储和自索引研究. [学位论文],天津师范大学,2009
[42]程华,徐军库,卢苇,大型应用软件系统自动回归测试工具的设计与实现.[学位论文],北京交通大学,2007
[43]刘芳,肖铁军,XML应用的基石:XML解析技术.计算机工程与设计,2005
[44]俞巍,XPath的两种解析技术. Computer Era No.1 2006
[45]吴志敏,基于JMX的IT管理关键技术研究和实现.[学位论文],2008
[46]孙明,周明天,詹瑾瑜,JMX动态管理服务的研究与设计.电子科技大学学报, 2002
[47]彭佳,申群太.一种多包传输网络控制系统的对象建模[J].网络与通信,2008.
[48]陈绍英,夏海涛,金成姬,Web性能测试实战,北京,电子工业出版社,2002,7—34
[49]张爽等译.微软的软件测试之道[M].机械工业出版社,2009.
[50]吴国新基于P2P的网络存储系统的研究与实现[D].东南大学, 2008
[2]张冬.大话存储——网络存储系统原理精解与最佳实践[M].北京:清华大学出版社,2008.
[3]段念.软件性能测试过程详解与案例剖析.北京:清华大学出版社,2006
[4]柳胜.性能测试从零开始[M].北京:电子工业出版社,2008:35-222.
[5]性能测试[EB/OL].http://baike.baidu.com/view/106187.html?wtp=tt,2005
[6]刘苗苗,Web性能测试的方法研究与工具实现,[学位论文],西安理工大学,2007
[7]付长东,舒继武,沈美明,郑纬民,网络存储性能基准的研究、评价与发展[J].小型微型计算机系统,2004,(25)12
[8]杨进,魏轶伟,贾惠波,李栋.存储区域网的性能测试[J].计算机工程,2003,(29)16
[9]马跃,李祥,基于TPC-C标准的数据库基准性能测试工具的研究和实现,[学位论文],贵州大学,2006
[10]干戈,王欣晖,王国仁,单吉第.TPC-C测试标准及其在面向对象数据库上的设计与实现[J].计算机科学,1998,(25)3
[11]王良,杨政,粟跃鹏.TPC-H分析与测试工具设计[J].计算机工程与应用,2007,43(3)
[12]邵芬,于国防,付海燕, AB:一种简单的性能测试工具[J].计算机时代,2007.12
[13]郝炜,性能测试工具LoadRunner介绍[A].计算机工程应用技术,2008
[14]朱怡雯钱超林勇,软件性能测试工具综述,FINANCIAL COMPUTER OF CHINA,2009,(7)
[15]赵燕君,Web结构软件性能测试工具的设计与实现.计算机工程与应用,2004
[16]朱敏,解群,性能测试工具的研究与设计.开发研究与设计技术,2005
[17]丁秀兰,崔冬华,Web测试中性能测试工具的研究与应用. [学位论文],太原理工大学,2008
[18]张静力,戴龙,陈继努,SAN存储技术在IPTV中的应用[J].中国有线电视,2006.
[19] Dustin Dustin Elfriede.软件自动化测试[Z].电子工业出版社,2003
[20]张建国,测试软件自动化生成环境的研究及其在相控雷达测试中的应用,[学位论文],电子科技大学,1997
[21] Tan, C.W., Siu, Y.M., Lee, K.K., Chan, Y.C., Cheng, L.M, Fabrication of smart card using UV curable anisotropic conductive adhesive (ACA) part II: reliability performance of the ACA joints,[C] Business of Electronic Product Reliabilityand Liability, 2004
[22] Zhao Gang, Chen Wenbing, Solving the Tramp Ship Dispatching Problem Using ACA[C], 26th Chinese Control Conference, 2007
[23] The Autonomous Component Architecture [EB/OL]. http://j-sim.cs.uiuc.edu/whitepaper/aca.thml,2006
[24] Ahmed Sobeih, Mahesh Viswanathan, Darko Marinov, Jennifer C. Hou. J-sim: An Integrated Environment for Simulation and Model Checking of Network Protocols [J]. IEEE Software, 2007.
[25] Ahmed Sobeih, Wei-Peng Chen, Jennifer C. Hou, Lu-Chuan Kung.A Simulation and Emulation Environment for Wireless Sensor Networks[z]. IEEE Software, 2006.
[26] Miller, J.A., Nair, R.S. JSIM: A Java-based simulation and animation environment, Simulation Symposium [C], 1997
[27] Hung-ying Tyan, Ahmed Sobih Jennifer C. Hou. Design, Realization and Evaluation of a Component-based, Compositional Network Simulation Environment[R]. SIMULATION, 2009
[28] J-Sim INET Tutorial [EB/OL]. http://j-sim.cs.uiuc.edu/drcl.inet/inet_tutorial.html,2003
[29] Tutorial-Working with J-sim [EB/OL]. http://j-sim.cs.uiuc.edu/tutorial/jsim_tutorial.html, 2003.
[30] Ns-2[EB/OL]. http://www.isi.edu/nsnam/ns/.2005
[31] Grenford J.Myers. The Art of Software Testing [M].John Wiley&Sons, 1979:4-18.
[32] Eric Freeman.Head First - Design Patterns[M].中国电力出版社,2007.
[33] Robert Spalding. Storage Networks: The Complete Reference[M].电子工业出版社2004:24-195.
[34] Richard Barker, Paul Massiglia. Storage Area Network Essentials[M].电子工业出版社,2004:17-118.
[35]李雅红.基于J-sim的主动节点内存资源管理[J].计算机工程与设计,2009.
[36]李雅红.基于J-sim的主动节点资源访问控制策略实现[J].微电子学与计算机,2009,
[37]李致远,闵林,毕俊蕾.基于J-sim的网络仿真分析与设计[J].计算机仿真,2007,(24)7.
[38]李捷,李致远.基于J-sim的移动代理网络仿真研究[J].河南大学学报,2008,38)1.
[39]佐丹.基于纯XML数据库Natix系统存储技术研究[D].哈尔滨工业大学, 2009
[40]竺明琴.浅析离散事件系统仿真描述模型的一般过程[J].七一六所科技学报,1997.
[41]傅厚荃,包小源,xml文件压缩存储和自索引研究. [学位论文],天津师范大学,2009
[42]程华,徐军库,卢苇,大型应用软件系统自动回归测试工具的设计与实现.[学位论文],北京交通大学,2007
[43]刘芳,肖铁军,XML应用的基石:XML解析技术.计算机工程与设计,2005
[44]俞巍,XPath的两种解析技术. Computer Era No.1 2006
[45]吴志敏,基于JMX的IT管理关键技术研究和实现.[学位论文],2008
[46]孙明,周明天,詹瑾瑜,JMX动态管理服务的研究与设计.电子科技大学学报, 2002
[47]彭佳,申群太.一种多包传输网络控制系统的对象建模[J].网络与通信,2008.
[48]陈绍英,夏海涛,金成姬,Web性能测试实战,北京,电子工业出版社,2002,7—34
[49]张爽等译.微软的软件测试之道[M].机械工业出版社,2009.
[50]吴国新基于P2P的网络存储系统的研究与实现[D].东南大学, 2008