摘要
云计算在2006年由Google的工程师提出之后,一直都在迅速发展。虽然云计算不是一种新技术,但是它是一种新组合,是对现有的几种成熟的技术的组合,如分布式计算、并行计算、网格计算和虚拟化技术等。随着Google, IBM, Amazon和微软等国外的IT巨头的云计算平台的快速发展,使得国内如中国移动、阿里巴巴等公司也纷纷加入到了云计算的研发行列。
本文首先综述了三种典型的云计算平台(分别是Google、Amazon和Azure)的特点与组成,并对这三种平台的服务类型、计算服务和存储服务等进行了分析和比较。
接着论述了云计算模型、关键技术和体系结构的层次。其中云计算模型包括五个关键特征,三个服务模型和四个部署模型；关键技术主要是虚拟化技术,能够为云服务提供商节省成本,提高云安全；云计算的体系结构层次主要分为基础设施即服务,平台即服务和软件即服务。
之后,对开源的云计算平台Hadoop和Eucalyptus进行了详细的分析,包括Hadoop的读写过程,计算模式以及Eucalyptus的体系结构。
在此基础上,基于云计算平台中用户所需服务多样化的需求,搭建了一个云计算平台,该云计算平台综合了Haddop和Eucalyptus所提供的服务模型,改变了现有云计算平台服务模型比较单一的现状,能够同时提供基础设施服务和平台服务,能够满足用户服务多样化的需求。之后对该平台中虚拟化、云安全、资源调度和能耗管理都有分析。
最后对该云计算平台中所涉及到的组件进行安装配置,运行测试。测试结果表明,本文所搭建的云计算平台能够提供基础设施服务和平台服务,满足了向用户提供多服务的需求。
Since the concept of Cloud Computing was firstly proposed by an engineer in Google in 2006, the technology of Cloud Computing has been developing rapidly. Although Cloud Computing is not a new technology, it is a new combination of some mature technologies, such as distributed computing, parallel computing, grid computing and virtualization technology. As some IT companies such as Google, Amazon, IBM develop Cloud Computing platforms rapidly, some domestic companies such as china mobile, alibaba, have also joined the ranks of Cloud Computing research and development.
Firstly, this paper reviewed the characteristics and composition of the three typical Cloud Computing platforms (Google, Amazon and AZure), and then analyzed their service types, computing services and storage services.
Secondly, we discussed the modes, key technologies and architecture level of Cloud Computing. Cloud Computing model includes five key characteristics, three service models and four deployment models, and the key technologies mainly include virtualization technology which can make cloud service providers to save costs and improve cloud security. Cloud Computing architecture can be divided into levels Infrastructure as a service, Platform as a service and software as a service.
Later, we made detailed analysis on the Hadoop and Eucalyptus which can be regarded as open source Cloud Computing platform. The analysis objects included the reading and writing process of hadoop, computing model and the architecture of Eucalyptus.
In view of that, we designed a Cloud Computing platform, which was composed of service models provided by Hadoop and Eucalyptus. This platform was able to provide infrastructure services and platform services and change the state that existing cloud computing platform can just provide a single service. We also analyzed some key technologies such as virtualization, cloud security, resource scheduling and energy management in this cloud computing platform.
Finally, we installed and configured the cloud computing platform components, then ran the test and implemented the cloud computing platform. The test show, this cloud computing platform can provide PaaS and IaaS at the same time, and it meet the user demand of multiple services.
引文
[1]Buyya R, Yeo CS, Venugopal S. Market-oriented cloud computing:Vision, hype, and reality for delivering IT services as computing utilities[C]. Proceedings 10th IEEE International Conference on High Performance Computing and Communications,2008,9(8):5-13
[2]Armbrust M, Fox A, Griffith R. "Above the clouds:A Berkeley view of cloud computing" [J]. Technical Report No UCB/EECS-2009-28,2009,55(86):32-47
[3]朱鹏程.深入浅出云计算[M].现代计算机(专业版),2009,17(9)： 59～61
[4]王庆波.虚拟化与云计算[M].北京：电子工业出版社,2009：40～47
[5]Foster I, Yong Z, Raicu I, Lu S. Cloud Computing and Grid Computing 360-Degree Compared[C]. Grid Computing Environments Workshop,2008,2008, 8(7):1-10
[6]杨小博,欧阳超.云计算与网格计算的特点分析[J].现代经济信息,2009,15(24)： 248～249
[7]刘鹏.云计算[M].北京：电子工业出版社,2010：63-70
[8]虢菲.云计算的发展现状与趋势[J].科技资讯,2010,8(14)： 14
[9]李艳华.云计算技术研究现状综述[J1.电脑知识与技术,2009,5(22)：6314～6315
[10]陈康,郑纬明.云计算：系统实例与研究现状[J].软件学报,2009,8(5)：1337N1348
[11]钟志水.云计算的现在和未来[J].现代计算机,2010,19(23)：34～37
[12]中兴通讯.云计算在电信业务中的应用分析[C].二届中国云计算大会,2010,2(5)：2-8
[13]谢娜.浅谈云计算技术现状[J].福建电脑,2009,25(7)：42
[14]张健.云计算概念和影响力解析[J].电信网技术,2009,21,17(1)：15～18
[15]李新苗.大云计划即将推出新版云安全仍是最大落地障碍[J].通信世界,2010,18(14)：22-23
[16]Barroso LA,Dean J,Holzle U. Web search for a planet:The Google cluster architecture[J]. IEEE Micro,2003,23(20):22-28
[17]Dean J, Ghemawat S. MapReduce Simplified data processing on large clusters[C]. USENIX Association Proceedings of the Sixth Symposium on Operating Systems Design and Implementation,2006,31(19):137-149
[18]Zaharia M, Konwinski A, Joseph A D. Improving mapreduce performance in heterogeneous environments[C]. Proceedings of the 8th USENIX conference on Operating systems design and implementation,2008,31(8):29-42
[19]Dean J,Ghemawat S. MapReduce:Simplified data processing on large cluster[C]. Communications of the ACM,2005,51(1).
[20]Dean J,Ghemawat S. Distributed programming with Mapreduce[M]. Sebastopol:O'Reilly Media,Inc,2007:371-384.
[21]Ghemawat S, Gobioff H, Leung ST. The Google file system[J]. ACM SIGOPS Operating Systems Review,2003,37(5):29-43
[22]Burrows M. The Chubby lock service for loosely-coupled distributed systems[C]. Proceedings of the 7th symposium on Operating systems design and implementation,2006,3(18):335-350
[23]Chandra T, Griesemer R, Redstone J. Paxos made live:An engineering perspective[C]. Proceedings of the Annual ACM Symposium on Principles of Distributed Computing,2007,16(8):398-407
[24]叶钰,李太宁,刘渊.基SimpleDB进行分布式数据云存储[J].泰州职业技术学院学报,2010,10(1)： 9-10
[25]Tejaswi Redkar. Windows Azure Platform[M].USA:Apress,2009:18-25
[26]Henry Li.Introducing Windows Azure[M].USA:Apress,2009:78-88
[27]Rojer Jennings.Cloud Computing with Windows Azure Platform[M].US:Wiley Publishing,2009:155-173
[28]Chris Hay, Brian H.Prince. Azure In Action [M].USA:Manning Publication, 2009:200-205
[29]Brunette G, Mogull R. Security Guidance for critical areas of focus in Cloud Computing V2[J]. Cloud Security Alliance,2009,1(1):1-27
[30]司品超.云计算的概念和现状及关键技术[J].2008年全困高性能计算机学术年会,2008,8(3)：486
[31]Fenn, M., Murphy, M.A., Martin, J. and Goasguen, S.. An Evaluation of KVM for Use in Cloud Computing[C]. Proc.2nd International Conference on the Virtual Computing Initiative, RTP, NC, USA, (2008)
[32]LagarCavilla H A, Whitney JA, Scannell A. SnowFlock:Rapid virtual Machine cloning for cloud computing[C].4th ACM European Conference on Computer Systems,2009,18(22):1-12
[33]王吴鹏,刘旺盛.虚拟化技术在云计算中的应用初探[J].脑知识与技术,2008,3(25)：1554～1565
[34]辛军,陈康,郑纬民.虚拟化的集群资源管理技术研究[J].计算机科学与探索,2010,4(4)：324～329
[35]Pearson S. Taking account of privacy when designing cloud computing services[C]. Proceedings of the 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing,2009,19(8):44-52
[36]Oberheide J, Cooke E, Jahanian F. Cloudav:N-version antivirus in the network cloud[C]. Proceedings of the 17th conference on Security symposium, 2008,21(11):91-106
[37]陈海波.云计算平台可信性增强技术的研究[D].上海：复旦大学,2008：
[38]Wu S, KL Wu. An Indexing Framework for Efficient Retrieval on the cloud[J]. IEEE Data Engineering Bulletin,2009,13(16):18-25
[39]王洪雨.云计算中动态数据迁移的关键技术研究[D].大连：大连海事大学,2010：
[40]赵春燕.云环境下作业调度算法研究与实现[D].北京：北京交通大学,2009：
[41]Srikantaiah S, Kansal A, Zhao F. Energy aware consolidation for cloud computing[C]. Proceedings of the 2008 conference on Power aware computing and systems,2008,32(40):155-175
[42]Lenk A. What's inside the cloud? An architectural map of the cloud landscape[C]. Proceedings of the 2009 ICSE Workshop on Software Engineering Challenges of Cloud Computing,2009,23(12):23-31
[43]M Hibler,R,Ricci,L.Stoller. Large-Scale Virtualization in the Emulab Network Testbed[C]. Procedings of the 2008 USENIX Annual Technical Conference,2008, 41(16):113-128
[44]L Litty,D Lie. Computer Meteorology:Monitoring Compute Clouds[C]. HotOS,2009,18(3):23-28
[45]B Sotomayor, R Montero, I M Llorente, I Foster. Capacity leasing in the cloud system using the OpenNebula Engine[C].In Cloud Computing and its Application,2008,19(32):36-45
[46]罗达强.探析Windows Azure Platform微软云计算平台[J].硅谷,2010, 18(16)： 9～10
[47]邓自立.云计算中的网络拓补设计和Hadoop平台研究[D].合肥：中国科学技术大学,2009：
[48]林清滢.基于Hadoop的云计算模型[J].现代计算机(专业版),2010,32(7)：114～116
[49]曹宁等.HDFS下载效率的优化[J].计算机应用,2010,30(8)：2060～2065
[50]谢桂兰,罗省贤.基于Hadoop MapReduce模型的应用研究[J].微型机与应用,2010,29(8)：4-7
[51]Tom White. Hadoop The Definitive Guide[M].USA:O'Reilly,2009:81-89
[52]Jason Venner. Pro Hadoop Build scalable and distributed applications in the cloud. USA:Apress,2009:213-220
[53]D.Nurmi,R.Wolski,C.Grzegorczyk,G.Obertelli. The eucalyptus open source cloud computing system[C]. In Cloud Computing and Application,2008,1(2):1-5
[54]Vouk, M.A. Cloud computing—Issues, research and implementations[C].30th International Conference on Information Technology Interfaces,2008,29(16):31-40
[55]Liang Jie Zhang,Qun Zhou. CCOA:Cloud Computing Open Architecture[J]. IEEE International Conference on Web Services,2009,19(20): 607-616
[56]Xu K. A cloud computing platform based on P2P[C]. Proceedings 2009 IEEE International Symposium on IT in Medicine and Education,2009,8(17):427-432
[57]Buyya R. Cloud computing and emerging IT platforms:Vision, hype, and reality for delivering computing as the 5th utility[J]. Future Generation Computer Systems,2009,25(6):599-616
[58]严骏.云计算安全研究[J].数字图书馆论坛,2009,25(9)： 23～28
[59]栾亚建，黄翀民,龚高晟.Hadoop平台的性能优化研究[J].计算机工程,2010,36(14)：262～263