基于字节级优化更新的云存储增量式网络编码方法研究
|
摘要
云存储系统是云计算系统概念的衍生和发展,是一种采用大量分布式存储资源以协同工作的方式来构建的大型集群应用系统,用于向用户提供安全可靠的网络存储服务。为提高云存储系统网络编码的有效性,提升数据的存储效率,文章提出一种基于字节级优化更新的云存储增量式网络编码方法。首先,提出一种字节级优化增量式更新模型技术(Opt-DUM)用于块级差分更新,通过只发送与受影响的编码字节相关的更新,实现云存储增量式编码效率的提升;其次,研究了在更新过程中生成更新向量、减少增量矩阵和文件大小变化的问题,并完成了云存储系统中所有参与模块的更新算法和通信协议的设计;最后,实验结果验证了所设计用于云存储系统中的文件更新网络编码方法的性能优势。
Cloud storage system is a derivative concept of the cloud computing system, and it is a kind of cluster system including large amounts of the distributed storage resources, which provide safe and reliable network storage service. In order to improve the effectiveness of network coding for cloud storage system and improve the storage efficiency of data, an incremental network coding method for cloud storage based on byte level optimization is proposed. Firstly, a byte level optimization technique(Opt-DUM) is proposed for block differential update, which can improve the efficiency of cloud storage incremental coding by only sending updates related to the affected encoding bytes; Secondly, the problem of generating the update vector, reducing the increment matrix and the change of the file size in the process of updating is studied, and the design of the updating algorithm and communication protocol of all the participating modules in the cloud storage system is completed; Finally, the experimental results verify the performance advantages of the network update algorithm designed for file update in cloud storage system.
Cloud storage system is a derivative concept of the cloud computing system, and it is a kind of cluster system including large amounts of the distributed storage resources, which provide safe and reliable network storage service. In order to improve the effectiveness of network coding for cloud storage system and improve the storage efficiency of data, an incremental network coding method for cloud storage based on byte level optimization is proposed. Firstly, a byte level optimization technique(Opt-DUM) is proposed for block differential update, which can improve the efficiency of cloud storage incremental coding by only sending updates related to the affected encoding bytes; Secondly, the problem of generating the update vector, reducing the increment matrix and the change of the file size in the process of updating is studied, and the design of the updating algorithm and communication protocol of all the participating modules in the cloud storage system is completed; Finally, the experimental results verify the performance advantages of the network update algorithm designed for file update in cloud storage system.
引文
[1]ZHOU Guoan,LI Qiang,CHEN Xin,et al.Summary of Research on Mass Small File Storage Technology in Cloud Environment[J].Netinfo Security,2014,14(6):11-17.周国安,李强,陈新,等.云环境下海量小文件存储技术研究综述[J].信息网络安全,2014,14(6):11-17.
[2]WANG Yuding,YANG Jiahai,XU Cong,et al.Survey on Access Control Technologies for Cloud Computing[J].Journal of Software,2015,26(5):1129-1150.王于丁,杨家海,徐聪,等.云计算访问控制技术研究综述[J].软件学报,2015,26(5):1129-1150.
[3]LEI Lei,CAI Quanwei,JING Jiwu,et al.Enforcing Access Controls on Encrypted Cloud Storage with Policy Hiding[J].Journal of Software,2016,27(6):1432-1450.雷蕾,蔡权伟,荆继武,等.支持策略隐藏的加密云存储访问控制机制[J].软件学报,2016,27(6):1432-1450.
[4]WA NG Long jiang,CH EN Yue,YA N X incheng,et al.Differential Data Updating Scheme for Network Coding Cloud Storage System[J].Journal of Communications,2017,38(3):154-164.王龙江,陈越,严新成,等.网络编码云存储系统差分数据更新方案[J].通信学报,2017,38(3):154-164.
[5]GLAUBER Gon?alves,IDILIO Drago,ANA Paula Couto da Silva,et al.The Impact of Content Sharing on Cloud Storage Bandwidth Consumption[J].IEEE Internet Computing,2016,20(4):26-35.
[6]HE Fei,WANG Lei,JING Jiwu,et al.Design and Implementation of Cloud Storage Security Enhancement System[J].Netinfo Security,2012(3):38-41.郝斐,王雷,荆继武,等.云存储安全增强系统的设计与实现[J].信息网络安全,2012(3):38-41.
[7]CUI Yong,LAI Zeqi,DAI Ningwei.A First Look At Mobile Cloud Storage Services:Architecture,Experimentation,and Challenges[J].IEEE Network,2016,30(4):16-21.
[8]LI Jianjiang,WU Jie,MA Zhanning.Frequency and SimilarityAware Partitioning for Cloud Storage Based on Space-Time Utility Maximization Model[J].Tsinghua Science and Technology,2015,20(3):233-245.
[9]YU Chiamu,CHEN Chiyuan,CHAO Hanchieh.Proof of Ownership in Deduplicated Cloud Storage with Mobile Device Efficiency[J].IEEE Network,2015,29(2):51-55.
[10]CHU Chengkang,ZHU Wentao,HAN Jin,et al.Security Concerns in Popular Cloud Storage Services[J].IEEE Pervasive Computing,2013,12(4):50-57.
[11]LI Ming,YU Shucheng,REN Kui,et al.Toward Privacyassured and Searchable Cloud Data Storage Services[J].IEEENetwork,2013,27(4):56-62.
[12]PITCHAI R,JAYASHRI S,RAJA J.Searchable Encrypted Data File Sharing Method Using Public Cloud Service for Secure Storage in Cloud Computing[J].Wireless Personal Communications,2016,90(2):947-960.
[13]HE Kai,HUANG Chuanhe,ZHOU Hao,et al.Public Auditing for Encrypted Data with Client-side Deduplication in Cloud Storage[J].Wuhan University Journal of Natural Sciences,2015,20(4):291-298.
[14]LI Chunta,LEE Chinwen,SHEN Jauji.An Extended Chaotic Maps-based Keyword Search Scheme Over Encrypted Data Resist Outside and Inside Keyword Guessing Attacks in Cloud Storage Services[J].Nonlinear Dynamics,2015,80(3):1601-1611.
[15]QIN Zhiguang,WU Shikun,Xiong Hu.Review of Data Integrity Audit Scheme in Cloud Storage Service[J].Netinfo Security,2014,14(7):1-6.秦志光,吴世坤,熊虎.云存储服务中数据完整性审计方案综述[J].信息网络安全,2014,14(7):1-6.
[16]CENGIZ Karakoyunlu,JOHN A Chandy.Exploiting User Metadata for Energy-aware Node Allocation in A Cloud Storage System[J].Journal of Computer and System Sciences,2016,82(2):282-309.
[2]WANG Yuding,YANG Jiahai,XU Cong,et al.Survey on Access Control Technologies for Cloud Computing[J].Journal of Software,2015,26(5):1129-1150.王于丁,杨家海,徐聪,等.云计算访问控制技术研究综述[J].软件学报,2015,26(5):1129-1150.
[3]LEI Lei,CAI Quanwei,JING Jiwu,et al.Enforcing Access Controls on Encrypted Cloud Storage with Policy Hiding[J].Journal of Software,2016,27(6):1432-1450.雷蕾,蔡权伟,荆继武,等.支持策略隐藏的加密云存储访问控制机制[J].软件学报,2016,27(6):1432-1450.
[4]WA NG Long jiang,CH EN Yue,YA N X incheng,et al.Differential Data Updating Scheme for Network Coding Cloud Storage System[J].Journal of Communications,2017,38(3):154-164.王龙江,陈越,严新成,等.网络编码云存储系统差分数据更新方案[J].通信学报,2017,38(3):154-164.
[5]GLAUBER Gon?alves,IDILIO Drago,ANA Paula Couto da Silva,et al.The Impact of Content Sharing on Cloud Storage Bandwidth Consumption[J].IEEE Internet Computing,2016,20(4):26-35.
[6]HE Fei,WANG Lei,JING Jiwu,et al.Design and Implementation of Cloud Storage Security Enhancement System[J].Netinfo Security,2012(3):38-41.郝斐,王雷,荆继武,等.云存储安全增强系统的设计与实现[J].信息网络安全,2012(3):38-41.
[7]CUI Yong,LAI Zeqi,DAI Ningwei.A First Look At Mobile Cloud Storage Services:Architecture,Experimentation,and Challenges[J].IEEE Network,2016,30(4):16-21.
[8]LI Jianjiang,WU Jie,MA Zhanning.Frequency and SimilarityAware Partitioning for Cloud Storage Based on Space-Time Utility Maximization Model[J].Tsinghua Science and Technology,2015,20(3):233-245.
[9]YU Chiamu,CHEN Chiyuan,CHAO Hanchieh.Proof of Ownership in Deduplicated Cloud Storage with Mobile Device Efficiency[J].IEEE Network,2015,29(2):51-55.
[10]CHU Chengkang,ZHU Wentao,HAN Jin,et al.Security Concerns in Popular Cloud Storage Services[J].IEEE Pervasive Computing,2013,12(4):50-57.
[11]LI Ming,YU Shucheng,REN Kui,et al.Toward Privacyassured and Searchable Cloud Data Storage Services[J].IEEENetwork,2013,27(4):56-62.
[12]PITCHAI R,JAYASHRI S,RAJA J.Searchable Encrypted Data File Sharing Method Using Public Cloud Service for Secure Storage in Cloud Computing[J].Wireless Personal Communications,2016,90(2):947-960.
[13]HE Kai,HUANG Chuanhe,ZHOU Hao,et al.Public Auditing for Encrypted Data with Client-side Deduplication in Cloud Storage[J].Wuhan University Journal of Natural Sciences,2015,20(4):291-298.
[14]LI Chunta,LEE Chinwen,SHEN Jauji.An Extended Chaotic Maps-based Keyword Search Scheme Over Encrypted Data Resist Outside and Inside Keyword Guessing Attacks in Cloud Storage Services[J].Nonlinear Dynamics,2015,80(3):1601-1611.
[15]QIN Zhiguang,WU Shikun,Xiong Hu.Review of Data Integrity Audit Scheme in Cloud Storage Service[J].Netinfo Security,2014,14(7):1-6.秦志光,吴世坤,熊虎.云存储服务中数据完整性审计方案综述[J].信息网络安全,2014,14(7):1-6.
[16]CENGIZ Karakoyunlu,JOHN A Chandy.Exploiting User Metadata for Energy-aware Node Allocation in A Cloud Storage System[J].Journal of Computer and System Sciences,2016,82(2):282-309.