用户名: 密码: 验证码:
混合供电数据中心能耗优化研究进展
详细信息    查看全文 | 推荐本文 |
  • 英文篇名:Research Advance on Energy Consumption Optimization of Hyper-Powered Data Center
  • 作者:宋杰 ; 孙宗哲 ; 刘慧 ; 鲍玉斌 ; 于戈
  • 英文作者:SONG Jie;SUN Zong-Zhe;LIU Hui;BAO Yu-Bin;YU Ge;Software College,Northeastern University;School of Metallurgy,Northeastern University;School of Computer Science and Engineering,Northeastern University;
  • 关键词:可再生能源 ; 绿色数据中心 ; 能耗优化 ; 能源利用率 ; 绿色计算
  • 英文关键词:renewable energy;;green data center;;energy consumption optimization;;energy utilization;;green computing
  • 中文刊名:JSJX
  • 英文刊名:Chinese Journal of Computers
  • 机构:东北大学软件学院;东北大学冶金学院;东北大学计算机科学与工程学院;
  • 出版日期:2018-05-15 10:19
  • 出版单位:计算机学报
  • 年:2018
  • 期:v.41;No.432
  • 基金:国家自然科学基金(61662057,61672143,61433008,U1435216,61502090,61402090);; 中央高校基本科研业务费专项资金(N161602003)资助~~
  • 语种:中文;
  • 页:JSJX201812003
  • 页数:19
  • CN:12
  • ISSN:11-1826/TP
  • 分类号:36-54
摘要
为支持无处不在的IT服务,数据中心像公路和电网一样已经成为了城市必备的基础设施,兆瓦级的数据中心在吞噬着大量能源的同时也给环境带来沉重压力,因此数据中心能耗优化研究备受关注.因为可再生能源的环境和经济成本低廉,人们更倾向于采用可再生能源与化石燃料混合的方式为数据中心供电.提高可再生能源利用率,降低化石燃料的使用量,是数据中心能耗优化的新目标.然而,可再生能源通常具有间歇性、不稳定性和动态变化性,如何在数据中心中充分利用可再生能源一直是一个难题.该文综述了近年来可再生能源混合供电的数据中心能耗优化的主要研究成果.该文首先总结能耗优化的基本思路,指出从资源层、计算层和服务层均可以实现提高可再生能源利用率和降低能源成本的优化目标;接着描述可再生能源供电模型和IT设备耗电模型,从功率控制和负载均衡两个角度对现有工作加以梳理,逐一分析现有优化技术,并针对每一项优化技术提出进一步的研究思路.最后该文根据现有研究成果,探求采用功率控制、负载均衡的软硬件方法能够实现的最佳优化效果,提出能耗优化的约束问题,包括研究思路、仍然存在的问题和可能的解决办法.
        To support ubiquitous IT services,data centers have become an essential infrastructure like roads and power grids for cities.The megawatt-level data centers have devoured a lot of energy while put much pressure on the environment.Researches about energy consumption optimization of data center are concerned by people.Because of the lower environmental and economic costs of renewable energy.Renewable energy is generally defined as energy that is collected from resources which are naturally replenished on a human timescale,such as sunlight,wind,rain,tides,waves,and geothermal heat.People are more inclined to use renewable energy and fossil fuel mix for powering data centers.The new goal of energy consumption optimization is not simple reduce the consumed energy,but to improve renewable energy utilization and reduce fossil energy consumption.However,renewable energy is intermittent,unstable and dynamic changes,hence,how to fully utilize renewable energy in a green data center remains to be a challenge.In thispaper,the state-of-the-art of energy consumption optimization in the renewable energy hyperpowered data center are reviewed.The paper first summarizes the basic ideas of the optimization,concludes the approaches to improve the renewable energy utilization and reduce the energy cost in the resource layer,computing layer and service layer of a data center,and explains the basic approaches of matching energy generation and consumption;Secondly,this paper describes the power generation model of renewable energy and power consumption model of IT equipment,in the former the solar energy and wind energy are highlighted,and in the latter the energy consumption model to the tasks,requests and virtual mechanisms are focused;Thirdly,the related works are explained from two aspects:power restriction and load balancing,meanwhile proposes the further research prospects for each optimization technique.The power restriction approaches mainly based on"Dynamic Voltage and Frequency Scaling"or"On-off Algorithm";while the load balancing is a big topic,it includes temporal load balance(workload scheduling)which balances the task scales among servers in one data center in real-time to adapt the renewable energy,or spatial load balance(geographical load scheduling)which balances the task scales among the geographical difference data centers to adapt their renewable energy locally and respectively.The load in both temporal and spatial load balance could be tasks or virtual machines;Finally,according to the existing research results,the best optimization effects that achieved by the software and hardware optimization approaches are argued.As the goal of maximize renewable energy utilization.The issue is abstracted as"power consumption-time curve"and "power generation-time curve"adaptation problem,which could be solved by transforming the"power generation-time curve"to match the"power generation-time curve".It would definitely confirmed the"power generationtime curve"if the"power consumption-time curve"could be freely transformed,however it is an ideal situation.There must be context related constraints on energy consumption optimization,such as energy conservation,SLA invariance,response time tradeoff,load migration costs.How to identify this constraint is a difficult problem to be solved.So that the problem of the optimization constraints,including research ideas,problems and possible solutions,are given to facilitate other researchers.
引文
[1]Ebrahimi K,Jones G F,Fleischer A S.A review of data center cooling technology,operating conditions and the corresponding low-grade waste heat recovery opportunities.Renewable and Sustainable Energy Reviews,2014,31:622-638
    [2]Romero M,Hasselqvist H,Svensson G.Supercomputers keeping people warm in the winter//Proceedings of the 2nd International Conference on ICT for Sustainability(ICTS).Stockholm,Sweden,2014:324-332
    [3]Song Jie,Sun Zong-Zhe,Li Tian-Tian,et al.Research advance on code oriented optimization of software energy consumption.Chinese Journal of Computers,2016,39(11):2270-2290(in Chinese)(宋杰,孙宗哲,李甜甜等.面向代码的软件能耗优化研究进展.计算机学报,2016,39(11):2270-2290)
    [4]Song J,He H Y,Wang Z,et al.Modulo based data placement algorithm for energy consumption optimization of MapReduce system.Journal of Grid Computing,2016,1:1-16
    [5]Deng Wei,Liu Fang-Ming,Jin Hai,et al.Leveraging renewable energy in cloud computing datacenters:State of the art and future research.Chinese Journal of Computers,2013,36(3):582-598(in Chinese)(邓维,刘方明,金海等.云计算数据中心的新能源应用:研究现状与趋势.计算机学报,2013,36(3):582-598)
    [6]Deng W,Liu F,Jin H,et al.Harnessing renewable energy in cloud datacenters:Opportunities and challenges.IEEENetwork,2014,28(1):48-55
    [7]Barroso L A,Clidaras J,H9lzle U.The Datacenter as a Computer.2nd Edition.San Rafael,USA:Morgan&Claypool Publishers,2013
    [8]Gupta P.Google to use wind energy to power data centers.New York Times,2010,19(4):19-24
    [9]Banerjee P,Patel C,Bash C,et al.Towards a net-zero data center.ACM Journal on Emerging Technologies in Computing Systems,2012,8(4):27
    [10]Zhao L,Brouwer J,James S,et al.Servers powered by a10kW in-rack proton exchange membrane fuel cell system//Proceedings of the ASME 2014 8th International Conference on Energy Sustainability&12th Fuel Cell Science,Engineering and Technology Conference.Boston,USA,2014:7-15
    [11]Sharma R,Christian T,Arlitt M,et al.Design of farm waste-driven supply side infrastructure for data centers//Proceedings of the ASME 2010 4th International Conference on Energy Sustainability.Phoenix,USA,2010:11-19
    [12]Ministry of Industry and Information Technology,National Energy Administration.National Green Data Center Pilot Program,2015(in Chinese)(工业和信息化部,国家能源局.国家绿色数据中心试点工作方案,2015)
    [13]Brandolese C.Source-level estimation of energy consumption and execution time of embedded software//Processing of the11th EUROMICRO Conference on Digital System Design Architectures,Methods and Tools.Parma,Italy,2008:115-123
    [14]Noureddine A,Rouvoy R,Seinturier L.Unit testing of energy consumption of software libraries//Proceedings of the 29th Annual ACM Symposium on Applied Computing.Gyeongju,Korea,2014:1200-1205
    [15]Patel M R.Wind and Solar Power Systems:Design,Analysis,and Operation.Florida,USA:CRC Press,2005
    [16]Noh D,Wang L,Yang Y,et al.Minimum variance energy allocation for a solar-powered sensor system.Distributed Computing in Sensor Systems,2009,16(7):44-57
    [17]Zuo Ran,Shi Ming-Heng,Wang Xi-Lin.Introduction to Renewable Energy.Beijing:China Machine Press,2007(in Chinese)(左然,施明恒,王希麟.可再生能源概论.北京:机械工业出版社,2007)
    [18]Holt C C.Forecasting seasonals and trends by exponentially weighted moving averages.International journal of forecasting,2004,20(1):5-10
    [19]Piorno J R,Bergonzini C,Atienza D,et al.Prediction and management in energy harvested wireless sensor nodes//Proceedings of the 2009 1st International Conference on Wireless Communication,Vehicular Technology,Information Theory and Aerospace&Electronic Systems Technology.Aalborg,Denmark,2009:6-10
    [20]Goiri I,Le K,Haque M E,et al.GreenSlot:Scheduling energy consumption in green datacenters//Proceedings of the 2011 International Conference for High Performance Computing,Networking,Storage and Analysis.New York,USA,2011:20
    [21]Goiri I,Le K,Nguyen T D,et al.GreenHadoop:Leveraging green energy in data-processing frameworks//Proceedings of the 7th ACM European Conference on Computer Systems.New York,USA,2012:57-70
    [22]Hossain M R,Oo A M T,Ali A B M S.Hybrid prediction method of solar power using different computational intelligence algorithms//Proceedings of the 2012 22nd Australasian Universities Power Engineering Conference.Bali,Indonesia,2012:1-6
    [23]Long H,Zhang Z,Su Y.Analysis of daily solar power prediction with data-driven approaches.Applied Energy,2014,126:29-37
    [24]Sharma N,Sharma P,Irwin D,et al.Predicting solar generation from weather forecasts using machine learning//Proceedings of the 2011IEEE International Conference on Smart Grid Communications.Kyoto,Japan,2011:528-533
    [25]Sharma N,Gummeson J,Irwin D,et al.Cloudy computing:Leveraging weather forecasts in energy harvesting sensor systems//Proceedings of the 2010 7th Annual IEEE Communications Society Conference on Sensor,Mesh and Ad Hoc Communications and Networks(SECON).Boston,USA,2010:1-9
    [26]Zeng J,Qiao W.Short-term solar power prediction using a support vector machine.Renewable Energy,2013,52:118-127
    [27]Ma L,Li B,Jie D,et al.Research on short-term wind farm output power prediction model based on meteorological data collected by WSN.International Journal of Hybrid Information Technology,2013,6(5):219-226
    [28]Chen N,Qian Z,Nabney I T,et al.Wind power forecasts using Gaussian processes and numerical weather prediction.IEEE Transactions on Power Systems,2014,29(2):656-665
    [29]Bo G,Chao A,Xinyu L.Study of wind power short-term prediction of wind farm based on NWP and fuzzy neural network.Journal of Theoretical&Applied Information Technology,2013,48(3):1668-1672
    [30]Wang H,Hu Z,Hu M,et al.Short-term prediction of wind farm power based on PSO-SVM//Proceedings of the 2012Asia-Pacific Power and Energy Engineering Conference.Shanghai,China,2012:1-4
    [31]Bai G,Ding Y,Yildirim M B,et al.Short-term prediction models for wind speed and wind power//Proceedings of the2014 2nd International Conference on Systems and Informatics(ICSAI).Shanghai,China,2014:180-185
    [32]Peri R M,Mandal P,Haque A U,et al.Very short-term prediction of wind farm power:An advanced hybrid intelligent approach//Proceedings of the Industry Applications Society Annual Meeting(IAS).TX,USA,2015:1-8
    [33]Stewart C,Shen K.Some joules are more precious than others:Managing renewable energy in the datacenter//Proceedings of the Workshop on Power Aware Computing and Systems.Santa Cruz,USA,2009:15-19
    [34]Stewart C,Leventi M,Shen K.Empirical examination of a collaborative web application//Proceedings of the 2008IEEEInternational Symposium on Workload Characterization(IISWC’08).Seattle,USA,2008:90-96
    [35]Kansal A,Zhao F,Liu J,et al.Virtual machine power metering and provisioning//Proceedings of the ACM Symposium on Cloud Computing.New York,USA,2010:39-50
    [36]Dupont C.Renewable energy aware data centres:The problem of controlling the applications workload//Energy-Efficient Data Centers.Berlin,Germany:Springer,2014:16-24
    [37]Li C,Zhang W,Cho C B,et al.SolarCore:Solar energy driven multi-core architecture power management//Proceedings of the 2011 IEEE 17th International Symposium on High Performance Computer Architecture.New York,USA,2011:205-216
    [38]Sharma N,Barker S,Irwin D,et al.Blink:Managing server clusters on intermittent power.ACM SIGPLAN Notices,2011,46(3):185-198
    [39]Zhou X,Cai H,Cao Q,et al.GreenGear:Leveraging and managing server heterogeneity for improving energy efficiency in green data centers//Proceedings of the 2016International Conference on Supercomputing.New York,USA,2016:12
    [40]Sharma N,Irwin D,Shenoy P.BlinkFS:A distributed file system for intermittent power.Sustainable Computing:Informatics and Systems,2015,6:69-80
    [41]Katsak W,Goiri I,Bianchini R,et al.GreenCassandra:Using renewable energy in distributed structured storage systems//Proceedings of the 2015 6th International Green and Sustainable Computing Conference(IGSC).Las Vegas,USA,2015:1-8
    [42]Cioara T,Anghel I,Antal M,et al.Data center optimization methodology to maximize the usage of locally produced renewable energy//Proceedings of the 2015 4th International Conference on Sustainable Internet and ICT for Sustainability(SustainIT).Madrid,Spain,2015:1-8
    [43]Commission C E.Renewable energy-overview.California Energy Commission-Tracking Progress,2015,7(5):112-167
    [44]Depoorter V,OróE,Salom J.The location as an energy efficiency and renewable energy supply measure for data centres in Europe.Applied Energy,2015,140:338-349
    [45]Chase J S,Anderson D C,Thakar P N,et al.Managing energy and server resources in hosting centers.ACMSIGOPS Operating Systems Review,2001,35(5):103-116
    [46]Krioukov A,Mohan P,Alspaugh S,et al.NapSAC:Design and implementation of a power-proportional web cluster.ACM SIGCOMM Computer Communication Review,2011,41(1):102-108
    [47]Ahmad F,Vijaykumar T N.Joint optimization of idle and cooling power in data centers while maintaining response time.ACM SIGPLAN Notices,2010,45(3):243-256
    [48]Moore J,Chase J,Ranganathan P,et al.Temperatureaware resource assignment in data centers.Proceedings of USENIX,2005,32(4):121-129
    [49]Moore J,Chase J S,Ranganathan P.Weatherman:Automated,online and predictive thermal mapping and management for data centers//Proceedings of the 3rd International Conference on Autonomic Computing.Dublin,Ireland,2006:155-164
    [50]Krioukov A,Alspaugh S,Mohan P,et al.Design and evaluation of an energy agile computing cluster.EECSDepartment,University of California,Berkeley:Technical Report UCB/EECS-2012-13,2012
    [51]Goiri I,Katsak W,Le K,et al.Parasol and GreenSwitch:Managing datacenters powered by renewable energy.ACMSIGARCH Computer Architecture News,2013,41(1):51-64
    [52]Cheng Dazhao,et al.Elastic power-aware resource provisioning of heterogeneous workloads in self-sustainable datacenters.IEEE Transactions on Computers,2016,65(2):508-521
    [53]Masker M,Nagel L,Brinkmann A,et al.Smart grid-aware scheduling in data centres.Computer Communications,2016,96:73-85
    [54]Adnan M A,Gupta R K.Workload shaping to mitigate variability in renewable power use by data centers//Proceedings of the 2014 IEEE 7th International Conference on Cloud Computing.Washington,USA,2014:96-103
    [55]Haque M E,Goiri I Z,Bianchini R,et al.GreenPar:Scheduling parallel high performance applications in green datacenters//Proceedings of the 29th ACM on International Conference on Supercomputing.New York,USA.2015:217-227
    [56]Chen C,He B,Tang X,et al.Green databases through integration of renewable energy//Proceedings of the Conference on Innovative Data Systems Research.California,USA,2013:112-119
    [57]Goiri I,Haque M E,Le K,et al.Matching renewable energy supply and demand in green datacenters.Ad Hoc Networks,2015,25:520-534
    [58]Niu Z,He B,Liu F.JouleMR:Towards cost-effective and green-aware data processing frameworks.IEEE Transactions on Big Data,2017,33(10):178-189
    [59]Hasan S,Kouki Y,Ledoux T,et al.Exploiting renewable sources:When green SLA becomes a possible reality in Cloud computing.IEEE Transactions on Cloud Computing,2015,5(2):249-262
    [60]Dupont C,Sheikhalishahi M,Facca F M,et al.An energy aware application controller for optimizing renewable energy consumption in cloud computing data centers//Proceedings of the 8th IEEE/ACM International Conference on Utility and Cloud Computing.Limassol,Cyprus,2015:195-204
    [61]Li C,Qouneh A,Li T.iSwitch:Coordinating and optimizing renewable energy powered server clusters//Proceedings of the 39th Annual International Symposium on Computer Architecture.Washington,USA,2012:512-523
    [62]Singh R,Irwin D E,Shenoy P J,et al.Yank:Enabling green data centers to pull the plug//Proceedings of the USENIX Symposium on Networked Systems Design and Implementation.Lombard,USA,2013:143-155
    [63]Wang X,Du Z,Chen Y,et al.A green-aware virtual machine migration strategy for sustainable datacenter powered by renewable energy.Simulation Modelling Practice and Theory,2015,58:3-14
    [64]Wang X,Zhang G,Yang M,et al.Green-aware virtual machine migration strategy in sustainable Cloud Computing Environments//Proceedings of the Cloud Computing-Architecture and Applications.Kolkata,India,2017:212-230
    [65]Cheng D,Jiang C,Zhou X.Heterogeneity-aware workload placement and migration in distributed sustainable datacenters//Proceedings of the 2014IEEE 28th International Parallel and Distributed Processing Symposium.Phoenix,USA,2014:307-316
    [66]Gu C,Liu C,Shi C,et al.A green scheduler for Cloud Data Centers using renewable energy//Proceedings of the International Conference on Algorithms and Architectures for Parallel Processing.Springer International Publishing.Kuala Lumpur,Malaysia,2015:476-491
    [67]Gu C,Huang H,Jia X.Green scheduling for cloud data centers using ESDs to store renewable energy//Proceedings of the 2016IEEE International Conference on Communications(ICC).Kuala Lumpur,Malaysia,2016:1-7
    [68]Deng X,Wu D,Shen J,et al.Eco-aware online power management and load scheduling for green cloud datacenters.IEEE Systems Journal,2016,10(1):78-87
    [69]Guo Y,Gong Y,Fang Y,et al.Energy and network aware workload management for sustainable data centers with thermal storage.IEEE Transactions on Parallel and Distributed Systems,2014,25(8):2030-2042
    [70]Erol-Kantarci M,Mouftah H T.Overlay energy circle formation for cloud data centers with renewable energy futures contracts//Proceedings of the 2014 IEEE Symposium on Computers and Communication(ISCC).Madeira,Portugal,2014:1-6
    [71]Toosi A N,Qu C,de Assun92o M D,et al.Renewableaware geographical load balancing of web applications for sustainable data centers.Journal of Network and Computer Applications,2017,83:155-168
    [72]Hatzopoulos D,Koutsopoulos I,Koutitas G,et al.Dynamic virtual machine allocation in cloud server facility systems with renewable energy sources//Proceedings of the 2013IEEE International Conference on Communications(ICC).Budapest,Hungary,2013:4217-4221
    [73]Xiang X,Lin C,Chen F,et al.Greening geo-distributed data centers by joint optimization of request routing and virtual machine scheduling//Proceedings of the 2014IEEE/ACM 7th International Conference on Utility and Cloud Computing(UCC).Washington,USA,2014:1-10
    [74]Wang H,Wei H.A greedy approach to cost-aware virtual machine allocation for 100%green data centers//Proceedings of the 2015 International Conference on Computational Science and Computational Intelligence(CSCI).San Diego,USA,2015:647-650
    [75]Ahvar E,Ahvar S,Mann Z A,et al.CACEV:A cost and carbon emission-efficient virtual machine placement method for green distributed clouds//Proceedings of the 2016IEEEInternational Conference on Services Computing(SCC).San Francisco,USA,2016:275-282
    [76]Zhu T,Wang H,Wei H.Cost-aware virtual machine allocation for off-grid green data centers//Proceedings of the 2017IEEE International Conference on Pervasive Computing and Communications Workshops(PerCom Workshops).Kona,USA,2017:291-295
    [77]Mandal U,Habib M,Zhang S,et al.Greening the cloud using renewable-energy-aware service migration.IEEE Network,2013,27(6):36-43
    [78]Giacobbe M,Celesti A,Fazio M,et al.An approach to reduce carbon dioxide emissions through virtual machine migrations in a sustainable cloud federation//Proceedings of the Sustainable Internet and ICT for Sustainability(SustainIT).Madrid,Spain,2015:1-4
    [79]Zhang L,Han T,Ansari N.Renewable energy-aware interdatacenter virtual machine migration over elastic optical networks//Proceedings of the 2015IEEE 7th International Conference on Cloud Computing Technology and Science(CloudCom).Vancouver,Canada,2015:440-443
    [80]Zhang L,Han T,Ansari N.Revenue driven virtual machine management in green datacenter networks towards big data//Proceedings of the Global Communications Conference(GLOBECOM).San Diego,USA,2016:1-6
    [81]Khosravi A,Nadjaran Toosi A,Buyya R.Online virtual machine migration for renewable energy usage maximization in geographically distributed cloud data centers.Concurrency and Computation:Practice and Experience,2017,34:74-92
    [82]Akoush S,Sohan R,Rice A,et al.Evaluating the viability of remote renewable energy in datacenter computing.Cambridge,UK:University of Cambridge,Technical Report:889,2016
    (1)http://news.163.com/15/0325/06/ALHI939P00014AEE.html
    (2)https://en.wikipedia.org/wiki/Wind_power_in_Wyoming2017
    (3)http://www.datacenterknowledge.com/archives/2011/04/16/facebook-installs-solar-panels-at-new-data-center/
    (4)http://www.datacenterknowledge.com/archives/2012/06/21/ebay-bloom-boxes-will-power-utah-data-center/
    (5)http://www.datacenterknowledge.com/archives/2017/01/26/huge-reno-solar-farm-in-the-works-for-apple-data-center/
    (6)https://www.greenbiz.com/article/alibaba-leading-chinaspush-cleaner-data-centers
    (7)可以选择将多余的电能进行储存,目前主要有3种储存方法:蓄电池、电力回馈(Net Metering)以及蓄水储电.然而,这3种方法均会产生电能损失,且储存代价较高.
    (1)http://googleblog.blogspot.com/2009/01/powering-googlesearch.html
    (1)http://rubis.ow2.org
    (1)又称Mirco-Serve,微型服务器,其CPU多为移动和嵌入式系统设计的低能耗CPU.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700