A feedback-based adaptive data migration method for hybrid storage VOD caching systems

详细信息    查看全文

• 作者：Qiang Ling ; Lixiang Xu ; Jinfeng Yan ; Yicheng Zhang…
• 关键词：SSD ; Caching ; Data migration ; Feedback
• 刊名：Multimedia Tools and Applications
• 出版年：2016
• 出版时间：January 2016
• 年：2016
• 卷：75
• 期：1
• 页码：165-180
• 全文大小：898 KB
• 参考文献：1.Abhari A, Soraya M (2010) Workload generation for youtube. Multimed Tools and Appl 46(1):91–118CrossRef
  2.Breslau L, Cao P, Fan L, Phillips G, Shenker S (1999) Web caching and zipf-like distributions: Evidence and implications. In: IEEE Eighteenth Annual Joint Conference on Computer and Communications Societies., pp. 126-134
  3.Chen T (2007) Obtaining the optimal cache document replacement policy for the caching system of an EC website. Eur J Oper Res 181(2):828–841CrossRef MATH
  4.Chen F, Koufaty DA, Zhang X (2011) Hystor: making the best use of solid state drives in high performance storage systems. In: Proceedings of the international conference on Supercomputing (ICS), pp. 22–32
  5.Cheong SK, Jeong JJ, Jeong YW, Ko DS, Lee YH (2011) Research on the I/O Performance Advancement of a Low Speed HDD Using DDR-SSD. In: Proceedings of the 6th International conference on Future Information Technology, pp 508–513
  6.Choi J, Reaz A, Mukherjee B (2012) A survey of user behavior in VoD service and bandwidth-saving multicast streaming schemes. IEEE Communications Surv and Tutorials 14(1):156–169CrossRef
  7.Dorf R, Bishop R (2007) Modern control systems , 11th Edition. Prentice Hall, NJ
  8.Dyaberi JM (2011) Networking and storage support for video-on-demand data delivery. Purdue University, West Lafayette, Indiana, USA
  9.Intel Corporation (1998) Understanding the flash translation layer (FTL) specification. Technical Report AP-684
  10.Kang JU, JoH, Kim JS, Lee J (2006) A superblock-based flash translation layer for NAND flash memory. In: Proceedings of the 6th ACM IEEE International conference on Embedded software. pp. 161–170
  11.Kim J , Kim JM, Noh SH , Min SL , Cho Y (2002) A space-efficient flash translation layer for compact flash systems. IEEE Trans on Consum Electron 48(2):366–375CrossRef
  12.Kim YJ, Lee SJ, Zhang K, Kim J (2007) I/O performance optimization techniques for hybrid hard disk-based mobile consumer devices. IEEE Trans Consum Electron 53(4):1469–1476CrossRef
  13.Koltsidas I, Viglas SD (2008) Flashing up the storage layer. In: Proceedings of VLDB, pp. 514–525
  14.Li R, Li C, Xiao W (2012) An efficient SSD-based hybrid storage architecture for large-scale search engines. In: Proceedings of the 41th International Conference on Parallel Processing, pp. 450–459
  15.Lin L, Zhu Y, Yue J, Cai Z, Segee B (2011) Hot random off-loading: A hybrid storage system with dynamic data migration. In: Proceedings of 19th Annual IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, pp. 318–325
  16.Narayanan D, Thereska E, Donnelly A, Elnikety S, Rowstron A (2009) Migrating server storage to SSDs: analysis of tradeoffs. In: Proceedings of the 4th ACM European Conference on computer systems, pp. 145–158
  17.Reisslein M, Hartanto F, Ross KW (2002) Interactive video streaming with proxy servers. Information Science, special issue on Interactive virtual environments and distance education 140(1-2):3–31MATH
  18.Robinson JT, Devarakonda MV (1990) Data cache management using frequency-based replacement. In: Proceedings of the 1990 ACM SIGMETRICS on the Measurement and Modeling of Computer Systems, pp. 132-142
  19.Soundararajan G, Prabhakaran V, Balakrishnan M, Wobber T (2010) Extending SSD lifetimeswith disk- Based write caches. In: Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST 10), pp. 101–114
  20.LFU-K: An effective buffer management replacement algorithm (2004)
  21.LRU-based algorithms for web cache replacement (2000)
  22.Wolf JL, Yu PS, Shachnai H (1997) Disk load balancing for video-on-demand systems. Multimed Syst 5(6):358–370CrossRef
  23.Wu KL, Yu PS, Wolf JL (2004) Segmentation of multimedia streams for proxy caching. IEEE Trans Multimed 6(5):770–780CrossRef
  24.Wu X, Reddy AN (2009) Managing storage space in a flash and disk hybrid storage system. In: Proceedings of IEEE MASCOTS, pp. 583–587
  25.Wu X, Reddy AN (2010) Exploiting concurrency to improve latency and throughput in a hybrid storage system. In: Proceedings of IEEE MASCOTS, pp. 14–23
  26.Wu X, Reddy AN (2012) Data organization in a hybrid storage system. In: Proceedings of International Conference on Computing, Networking and Communications (ICNC), pp. 583–587
  27.Yoon UK, Kim HJ (2009) Improving Hybrid Flash-Disk Storage by Incorporating Sequential Pattern Mining into Fully-Associative Sector Translation. In: Proceedings of International Conferenceon Computational Science and Engineering, pp 189–196
  28.Yoon UK, Kim HJ, Chang JY (2010) Intelligent Data Prefetching for Hybrid Flash-Disk Storage Using Sequential Pattern Mining Technique. In: Proceedings of IEEE/ACIS 9th International Conference on Computer and Information Science, pp 280–285
  29.Yu J, Chou CT, Yang Z, Du X,Wang T (2006) A dynamic caching algorithm based on internal popularity distribution of streaming media. Multimed Syst 12(2):135–149CrossRef
  
• 作者单位：Qiang Ling (1)
  Lixiang Xu (1)
  Jinfeng Yan (1)
  Yicheng Zhang (1)
  Feng Li (1)
  
  1. Department of Automation, University of Science and Technology of China, Hefei, 230027, China
  
• 刊物类别：Computer Science
• 刊物主题：Multimedia Information Systems
  Computer Communication Networks
  Data Structures, Cryptology and Information Theory
  Special Purpose and Application-Based Systems
  
• 出版者：Springer Netherlands
• ISSN：1573-7721

文摘

Nowadays Video-On-Demand (VOD) caching systems are often equipped with hybrid storage devices, which have been designed to combine the high read speed of Solid State Disks (SSDs) and the large capacity of Hard Disk Drives (HDDs). However, the number of erase cycles of SSDs is limited. So it is important to control the write load of SSDs in real applications. This paper proposes a Feedback-based Adaptive Data Migration (FADM) method, which can utilize the real-time feedback of the write load of SSDs to adjust the rule of moving data between HDDs and SSDs. More specifically, a video in HDDs is allowed to be moved into SSDs when its popularity is higher than that of the least popular video in SSDs by a threshold. This threshold is adaptively adjusted according to the feedback of the write load of SSDs. With FADM, the desired lifetime of SSDs can be well guaranteed even under various user behaviors while good read performance can be maintained. Simulations are done to demonstrate the effectiveness of FADM.