基于存储区域网的数据备份系统的研究与设计
|
摘要
存储区域网(SAN)是一种类似于LAN的高速网络技术,它用来在存储单元与客户端之间建立直接的高速数据连接。与LAIN不同的是SAN针对存储备份进行了优化,通常使用专用的通信协议,比如SCSI协议和FC协议,而不是LAN使用的各种通信协议。
随着网络基础建设的逐步发展与完善,SAN技术由于其自身所具有的诸多优点正在得到越来越广泛的应用。同时数据信息的急剧膨胀,对数据备份系统的规模、效率、安全性和可靠性都提出了更高的要求。现有的备份系统主要包括分布式备份系统和基于LAN的备份系统。但是,这些备份系统的备份速度较慢且都会影响服务器的性能,已经不能满足现有应用的要求。因此,设计一个速度快、性能优的备份系统就非常有意义了。
论文深入分析了网络备份系统的各个层次的主要问题,提出了解决问题的总体方案。经过详细考虑和多方论证,本文设计了一种基于存储区域网的网络备份系统。本系统是一个三层结构的网络备份系统,它以SAN技术为基础,使用FC通信协议,在现有的SAN备份模型上引入了一个管理协议——网络数据管理协议(NDMP)来对该备份系统进行管理和控制。一方面,通过使用FC协议SAN网络可以提供高速传输能力,从而提高了备份速度、减小了备份窗口;另一方面,NDMP协议对备份系统中的数据流和控制流进行了有效的管理与控制,大大地减轻了服务器的负担。在三层结构的网络各份系统中,软件复杂程度从下往上逐步增加,而数据通信量从上往下不断增大,极大地提高了备份性能。该模型不但结构简单、便于维护,而且不使用特殊器件,是一个具有较好整体性能的网络备份系统。
The storage area network (SAN) is a high-speed network technology similar with LAN. It can provide high-speed connection between storage units and clients. Unlike LAN, SAN optimizes the storage and backup. SAN uses some special communication protocols, such as SCSI and FC, instead of the normal protocols that LAN uses.With the development and consummation of the network infrastructures, SAN technology is being used more and more widely because of its advantages. And with the rapid increasing of data information, modern network storage systems are now bidding for more and more demands on data backup in scalability, efficiency, security and availability. The existing backup systems mainly include distributed backup system and backup system based on LAN. But these systems can't be quite suitable for the requirement of the applications, because the backup speed of these systems is slow and the servers' performance of these systems is being affected. So design a high-speed and high-performance backup system has very important realistic meaning.The thesis deeply analyses the mainly problems of the network backup system, then put forward a settled project of these problems. Through the detailed consideration and many aspects demonstration, this thesis designs a network backup system based on SAN. This system is a three-layer network backup system. It based on SAN, and uses the FC communication protocol and imports a management protocol—network data management protocol (NDMP) into the existing SAN backup model to manage and control the backup system. On one hand, with the aid of high-speed transport ability provided by FC communication protocol, it can increase the system's backup speed and reduce the system's backup window. On the other hand, NDMP can effectively manage the system's data stream and control stream, so it can greatly lighten the system's burden. In this three-layer network backup system, the complexity of software is increasing from bottom to top, and the data traffic is increasing from top to bottom, its greatly increase the system's performance. This system model not only has simple structure and easy to
maintain, but also needn't special components. In one word, it is a network backup system with better holistic performance.
随着网络基础建设的逐步发展与完善,SAN技术由于其自身所具有的诸多优点正在得到越来越广泛的应用。同时数据信息的急剧膨胀,对数据备份系统的规模、效率、安全性和可靠性都提出了更高的要求。现有的备份系统主要包括分布式备份系统和基于LAN的备份系统。但是,这些备份系统的备份速度较慢且都会影响服务器的性能,已经不能满足现有应用的要求。因此,设计一个速度快、性能优的备份系统就非常有意义了。
论文深入分析了网络备份系统的各个层次的主要问题,提出了解决问题的总体方案。经过详细考虑和多方论证,本文设计了一种基于存储区域网的网络备份系统。本系统是一个三层结构的网络备份系统,它以SAN技术为基础,使用FC通信协议,在现有的SAN备份模型上引入了一个管理协议——网络数据管理协议(NDMP)来对该备份系统进行管理和控制。一方面,通过使用FC协议SAN网络可以提供高速传输能力,从而提高了备份速度、减小了备份窗口;另一方面,NDMP协议对备份系统中的数据流和控制流进行了有效的管理与控制,大大地减轻了服务器的负担。在三层结构的网络各份系统中,软件复杂程度从下往上逐步增加,而数据通信量从上往下不断增大,极大地提高了备份性能。该模型不但结构简单、便于维护,而且不使用特殊器件,是一个具有较好整体性能的网络备份系统。
The storage area network (SAN) is a high-speed network technology similar with LAN. It can provide high-speed connection between storage units and clients. Unlike LAN, SAN optimizes the storage and backup. SAN uses some special communication protocols, such as SCSI and FC, instead of the normal protocols that LAN uses.With the development and consummation of the network infrastructures, SAN technology is being used more and more widely because of its advantages. And with the rapid increasing of data information, modern network storage systems are now bidding for more and more demands on data backup in scalability, efficiency, security and availability. The existing backup systems mainly include distributed backup system and backup system based on LAN. But these systems can't be quite suitable for the requirement of the applications, because the backup speed of these systems is slow and the servers' performance of these systems is being affected. So design a high-speed and high-performance backup system has very important realistic meaning.The thesis deeply analyses the mainly problems of the network backup system, then put forward a settled project of these problems. Through the detailed consideration and many aspects demonstration, this thesis designs a network backup system based on SAN. This system is a three-layer network backup system. It based on SAN, and uses the FC communication protocol and imports a management protocol—network data management protocol (NDMP) into the existing SAN backup model to manage and control the backup system. On one hand, with the aid of high-speed transport ability provided by FC communication protocol, it can increase the system's backup speed and reduce the system's backup window. On the other hand, NDMP can effectively manage the system's data stream and control stream, so it can greatly lighten the system's burden. In this three-layer network backup system, the complexity of software is increasing from bottom to top, and the data traffic is increasing from top to bottom, its greatly increase the system's performance. This system model not only has simple structure and easy to
maintain, but also needn't special components. In one word, it is a network backup system with better holistic performance.
引文
[1] MetaStor. SAN Basics. http://www.bootsystems.com
[2] 秦保社.网络存储技术的发展.微机发展,2002年01期:74～77
[3] 韩德志.网络存储数据访问技术的探讨.微型电脑应用,2002年16卷08期:33～36
[4] 蔡皖东.基于SAN的高可用性网络存储解决方案.小型微型计算机系统,2001年3月22卷03期:284～287
[5] 韩德志,兰军端.网络存储技术的探讨.微型电脑应用,2000年16卷03期:5～8
[6] 周可,黄永峰,张江陵.网络存储技术研究.电子计算机与外部设备,1999年24卷02期:12～14
[7] 程鸿.降低SAN的门槛.计算机世界,2002(10):8～12
[8] 张伟.网络存储技术的发展现状与应用.福建电脑,2003年第1期:8～9
[9] 黄振宇.iSCSI SAN技术及其应用.计算机时代,2003年05期:1～3
[10] 娆锦.存储技术的几大热门应用.现代通信,2202年第10期:12～13
[11] 汪社教,宋华军,田毅农.网络存储技术及其应用研究.现代图书情报技术,2004年第3期:60～63
[12] 吴弯,裴先登.并行计算机中的网络存储.鄂州大学学报,1999年03期:20～25
[13] 谢长生,陆正武等.iSCSI为网络存储而生.计算机世界(产品与技术版),2002年12月:30～31
[14] 付长冬,舒继武,沈美明,郑纬民.网络存储体系结构的发展和研究.小型微型计算机系统,2004年4月25卷04期:485～489
[15] 谢元贞.数据备份技术.自动化技术与应用,2001,3,55～56
[16] Mason, W. Anthony. Realizing storage area network for clustered file systems. OSR Open System Resources, Inc, Amherst, NH, USA
[17] Kalagher Dan. Extending the reach of fibre channel storage solutions using SAN spanning technology. Storage Management Solutions
[18] IBM Technology Group. End-to-End Services for Multi-vendor Storage Area Networks(SANs)
[19] 孙路阳,李红为.网络备份技术的应用.网络技术,2002,5,总第62期:15～18
[20] 詹弘.浅析网络数据的备份与恢复.山西电力,2002年12月06期:46～49
[21 周敬利,高同庆.高速串行SCSI接口设计.小型微型计算机系统,1998,19(10):19～33
[22] 顾鹏,刘立刚,谢长生.数据存储系统备份技术研究与分析.计算机安全,2003,6:71～72
[23] Isra91. Iarael, R.K., Foster A. W. Evolutionary Path to Network Storage Management. In USENIX Winter'91, Dallas, TX, USENIX, 1991, 185～197
[24] A. L. Buck and R. A. Coyne, Jr., Dynamic hierarchies and optimization in distributed storage system in Digest of Thesiss, Eleventh IEEE Symposium on Mass Storage System. New York: IEEE Computer Society Press, Oct. 1991, 7～10
[25] Sachs, M. W., A. Varma. Fibre channel and related standards. IEEE Communications Magazine, 1996, 34(8), 40～50
[26] Benner A. F., Fibre Channel: Gigabit Communications and I/O for Computer Network. McGraw Hill, New York, 1996, 9～11
[27] 唐勇,潘龙法.光纤通道——连接未来网络和通道的桥梁.电子计算机与外部设备,1998,22(5):4～8
[28] 李洋,周敬利,余胜生.基于Fibre Channel的存储区域网设计与实现.计算机应用研究,2000,17(8):61～63
[29] 高同庆,周敬利,夏涛.光纤通道网络设计.计算机工程,1999,25(3):48～53
[30] ANSI, Fibre channel physical and signaling interface-3(FC-PH-3). X3T11/Project 1119D/Rev 9.2, June 1997, 75～84
[31] 64-bit PCI-to-Fibre Channel Adapter: QLA2200. QLogic Corp, Feb, 1999, 1～7
[32] E. Hall et al. The Rainbow-Ⅱ gigabit optical network. IEEE Journal Selected Areas in Communications, June 1996, 14(5): 814～823
[33] 包洪洋.计算机网络数据备份策略.计算机系统应用技术,2001,12:59～60
[34] Marc Farley.SAN存储区域网络(第二版).孙功星等译.北京:机械工业出版社,2001,12
[35] NIIT.存储区域网概念与应用.北京:人民邮电出版社,2002,6
[36] R. Hyer, R. Ruef, and R. W. Watson, High Performance Direct Network Data Transfers at the National Storage Laboratory. Proceedings Twelfth IEEE Symposium on Mass Storage, Monterey, CA (Apr. 1993).
[37 M. Bancroft, N. Bear, J. Finlayson, R. Hill, R. Isicoff, and H. Thompson. Functionality and Performance Evaluation of File Systems for Storage Area Networks (SAN). Proceedings Eighth Goddard Conference on Mass Storage Systems, College Park, MD (Mar 2000)
[38] http://www.ndmp.org, 2004
[39] Michael Peterson, Strategic Research Corp. Storage Area Networking～The Next Network. http://www.sresearch.com
[40] Steve Richardson. Implementing Storage Area Network Backup: Exploiting the Potential of SAN-Based Tape Automation
[41] Dave Fetters. Building a Storage Area Network. http://www.techweb.com
[42] 余胜生,刘念,周敬利.一种基于光纤通道存储区域网的存储管理系统的设计与实现.小型微型计算机系统,2002,23(4):401～404
[43] C. Jurgens. Fibre Channel: A connection to the future. IEEE Computer, 1995, 28(8): 88～90
[44] Tom Clerk. Designing storage area network: A practical reference for implementing fibre channel SANs. The Addison-wesley networking basics series, 1999, 43～122
[2] 秦保社.网络存储技术的发展.微机发展,2002年01期:74～77
[3] 韩德志.网络存储数据访问技术的探讨.微型电脑应用,2002年16卷08期:33～36
[4] 蔡皖东.基于SAN的高可用性网络存储解决方案.小型微型计算机系统,2001年3月22卷03期:284～287
[5] 韩德志,兰军端.网络存储技术的探讨.微型电脑应用,2000年16卷03期:5～8
[6] 周可,黄永峰,张江陵.网络存储技术研究.电子计算机与外部设备,1999年24卷02期:12～14
[7] 程鸿.降低SAN的门槛.计算机世界,2002(10):8～12
[8] 张伟.网络存储技术的发展现状与应用.福建电脑,2003年第1期:8～9
[9] 黄振宇.iSCSI SAN技术及其应用.计算机时代,2003年05期:1～3
[10] 娆锦.存储技术的几大热门应用.现代通信,2202年第10期:12～13
[11] 汪社教,宋华军,田毅农.网络存储技术及其应用研究.现代图书情报技术,2004年第3期:60～63
[12] 吴弯,裴先登.并行计算机中的网络存储.鄂州大学学报,1999年03期:20～25
[13] 谢长生,陆正武等.iSCSI为网络存储而生.计算机世界(产品与技术版),2002年12月:30～31
[14] 付长冬,舒继武,沈美明,郑纬民.网络存储体系结构的发展和研究.小型微型计算机系统,2004年4月25卷04期:485～489
[15] 谢元贞.数据备份技术.自动化技术与应用,2001,3,55～56
[16] Mason, W. Anthony. Realizing storage area network for clustered file systems. OSR Open System Resources, Inc, Amherst, NH, USA
[17] Kalagher Dan. Extending the reach of fibre channel storage solutions using SAN spanning technology. Storage Management Solutions
[18] IBM Technology Group. End-to-End Services for Multi-vendor Storage Area Networks(SANs)
[19] 孙路阳,李红为.网络备份技术的应用.网络技术,2002,5,总第62期:15～18
[20] 詹弘.浅析网络数据的备份与恢复.山西电力,2002年12月06期:46～49
[21 周敬利,高同庆.高速串行SCSI接口设计.小型微型计算机系统,1998,19(10):19～33
[22] 顾鹏,刘立刚,谢长生.数据存储系统备份技术研究与分析.计算机安全,2003,6:71～72
[23] Isra91. Iarael, R.K., Foster A. W. Evolutionary Path to Network Storage Management. In USENIX Winter'91, Dallas, TX, USENIX, 1991, 185～197
[24] A. L. Buck and R. A. Coyne, Jr., Dynamic hierarchies and optimization in distributed storage system in Digest of Thesiss, Eleventh IEEE Symposium on Mass Storage System. New York: IEEE Computer Society Press, Oct. 1991, 7～10
[25] Sachs, M. W., A. Varma. Fibre channel and related standards. IEEE Communications Magazine, 1996, 34(8), 40～50
[26] Benner A. F., Fibre Channel: Gigabit Communications and I/O for Computer Network. McGraw Hill, New York, 1996, 9～11
[27] 唐勇,潘龙法.光纤通道——连接未来网络和通道的桥梁.电子计算机与外部设备,1998,22(5):4～8
[28] 李洋,周敬利,余胜生.基于Fibre Channel的存储区域网设计与实现.计算机应用研究,2000,17(8):61～63
[29] 高同庆,周敬利,夏涛.光纤通道网络设计.计算机工程,1999,25(3):48～53
[30] ANSI, Fibre channel physical and signaling interface-3(FC-PH-3). X3T11/Project 1119D/Rev 9.2, June 1997, 75～84
[31] 64-bit PCI-to-Fibre Channel Adapter: QLA2200. QLogic Corp, Feb, 1999, 1～7
[32] E. Hall et al. The Rainbow-Ⅱ gigabit optical network. IEEE Journal Selected Areas in Communications, June 1996, 14(5): 814～823
[33] 包洪洋.计算机网络数据备份策略.计算机系统应用技术,2001,12:59～60
[34] Marc Farley.SAN存储区域网络(第二版).孙功星等译.北京:机械工业出版社,2001,12
[35] NIIT.存储区域网概念与应用.北京:人民邮电出版社,2002,6
[36] R. Hyer, R. Ruef, and R. W. Watson, High Performance Direct Network Data Transfers at the National Storage Laboratory. Proceedings Twelfth IEEE Symposium on Mass Storage, Monterey, CA (Apr. 1993).
[37 M. Bancroft, N. Bear, J. Finlayson, R. Hill, R. Isicoff, and H. Thompson. Functionality and Performance Evaluation of File Systems for Storage Area Networks (SAN). Proceedings Eighth Goddard Conference on Mass Storage Systems, College Park, MD (Mar 2000)
[38] http://www.ndmp.org, 2004
[39] Michael Peterson, Strategic Research Corp. Storage Area Networking～The Next Network. http://www.sresearch.com
[40] Steve Richardson. Implementing Storage Area Network Backup: Exploiting the Potential of SAN-Based Tape Automation
[41] Dave Fetters. Building a Storage Area Network. http://www.techweb.com
[42] 余胜生,刘念,周敬利.一种基于光纤通道存储区域网的存储管理系统的设计与实现.小型微型计算机系统,2002,23(4):401～404
[43] C. Jurgens. Fibre Channel: A connection to the future. IEEE Computer, 1995, 28(8): 88～90
[44] Tom Clerk. Designing storage area network: A practical reference for implementing fibre channel SANs. The Addison-wesley networking basics series, 1999, 43～122