Towards Cost-Effective Cloud Downloading with Tencent Big Data

详细信息    查看全文

• 作者：Zhen-Hua Li ; Gang Liu ; Zhi-Yuan Ji…
• 关键词：cloud downloading ; cost ; effective ; design trade ; off ; big data
• 刊名：Journal of Computer Science and Technology
• 出版年：2015
• 出版时间：November 2015
• 年：2015
• 卷：30
• 期：6
• 页码：1163-1174
• 全文大小：1,383 KB
• 参考文献：[1]Liu Y, Guo L, Li F, Chen S. An empirical evaluation of battery power consumption for streaming data transmission to mobile devices. In Proc. the 19th ACM-MM, Nov.28–Dec.1, 2011, pp.473-82.
  [2]Chen G, Li Z. Peer-to-Peer Network: Structure, Application and Design. Tsinghua University Press, Sep. 2007. (in Chinese)
  [3]Liu Y, Xiao L, Liu X, Ni L M, Zhang X. Location awareness in unstructured peer-to-peer systems. IEEE Transactions on Parallel and Distributed Systems, 2005, 16(2): 163-74.
  [4]Wen Y, Zhu X, Rodrigues J, Chen C. Cloud mobile media: Reflections and outlook. IEEE Transactions on Multimedia, 2014, 16(4): 885-02.
  [5]Huang Y, Li Z, Liu G, Dai Y. Cloud download: Using cloud utilities to achieve high-quality content distribution for unpopular videos. In Proc. the 19th ACM-MM, Nov.28–Dec.1, 2011, pp.213-22.
  [6]Ao N, Xu Y, Chen C, Guo Y. Offline downloading: A non-traditional cloud-accelerated and peer-assisted file distribution service. In Proc. the 4th CyberC, Oct. 2012, pp.81-8.
  [7]Zhou Y, Fu Z, Chiu D M, Huang Y. An adaptive cloud downloading service. IEEE Transactions on Multimedia, 2013, 15(4): 802-10.
  [8]Li Z, Huang Y, Liu G, Wang F, Zhang Z L, Dai Y. Cloud Transcoder: Bridging the format and resolution gap between Internet videos and mobile devices. In Proc. the 22nd ACM NOSSDAV, Jun. 2012, pp.33-8.
  [9]Hu H, Wen Y, Chua T, Li X. Towards scalable systems for big data analytics: A technology tutorial. IEEE Access, 2014, 2: 652-87.
  [10]Podlipnig S, B?sz?rmenyi L. A survey of web cache replacement strategies. ACM Computing Surveys, 2003, 35(4): 374-98.
  [11]Zhang J, Izmailov R, Reininger D, Ott M. Web caching framework: Analytical models and beyond. In Proc. IEEE Workshop on Internet Applications (WIA), Jul. 1999, pp.132-41.
  [12]Arlitt M, Cherkasova L, Dilley J, Friedrich R, Jin T. Evaluating content management techniques for web proxy caches. ACM SIGMETRICS Performance Evaluation Review, 2000, 27(4): 3-1.
  [13]Wu D, Hou Y T, Zhu W, Zhang Y Q, Peha J M. Streaming video over the Internet: Approaches and directions. IEEE Transactions on Circuits and Systems for Video Technology, 2001, 11(3): 282-00.
  [14]Li Z, Cao J, Chen G. ContinuStreaming: Achieving high playback continuity of gossip-based peer-to-peer streaming. In Proc. the 22nd IEEE IPDPS, Apr. 2008.
  [15]Liu F, Shen S, Li B, Li B, Yin H, Li S. Novasky: Cinematic-quality VoD in a P2P storage cloud. In Proc. the 30th INFOCOM, Apr. 2011, pp.936-44.
  [16]Yin H, Liu X, Zhan T, Sekar V, Qiu F, Lin C, Zhang H, Li B. Design and deployment of a hybrid CDN-P2P system for live video streaming: Experiences with LiveSky. In Proc. the 17th ACM-MM, Oct. 2009, pp.25-4.
  [17]Wu C, Li B, Zhao S. On dynamic server provisioning in multichannel P2P live streaming. IEEE/ACM Transactions on Networking, 2011, 19(5): 1317-330.
  [18]Li Z, Huang Y, Liu G, Wang F, Liu Y, Zhang Z L, Dai Y. Challenges, designs and performances of large-scale open-P2SP content distribution. IEEE Transactions on Parallel and Distributed Systems, 2013, 24(11): 2181-191.
  [19]Li Z, Zhang T, Huang Y, Zhang Z L, Dai Y. Maximizing the bandwidth multiplier effect for hybrid Cloud-P2P content distribution. In Proc. the 20th ACM/IEEE IWQoS, Jun. 2012, pp.20:1-0:9.
  [20]Li Z, Wilson C, Xu T, Liu Y, Lu Z, Wang Y. Offline downloading in China: A comparative study. In Proc. the 15th ACM IMC, Oct. 2015.
  
• 作者单位：Zhen-Hua Li (1) (2)
  Gang Liu (3)
  Zhi-Yuan Ji (4)
  Roger Zimmermann (5)
  
  1. School of Software, Tsinghua University, Beijing, 100084, China
  2. Tsinghua National Laboratory for Information Science and Technology, Beijing, 100084, China
  3. QQXuanfeng System Group, Tencent Co., Ltd, Shanghai, 200233, China
  4. High Technology Research and Development Center, Ministry of Science and Technology, Beijing, 100044, China
  5. Department of Computer Science, National University of Singapore, Singapore, 117417, Singapore
  
• 刊物类别：Computer Science
• 刊物主题：Computer Science, general
  Software Engineering
  Theory of Computation
  Data Structures, Cryptology and Information Theory
  Artificial Intelligence and Robotics
  Information Systems Applications and The Internet
  Chinese Library of Science
  
• 出版者：Springer Boston
• ISSN：1860-4749

文摘

The cloud downloading scheme, first proposed by us in 2011, has effectively optimized hundreds of millions of users-downloading experiences. Also, people start to build a variety of useful Internet services on top of cloud downloading. In brief, by using cloud facilities to download (and cache) the requested file from the “best-effort-Internet on behalf of the user, cloud downloading ensures the data availability and remarkably enhances the data delivery speed. Although this scheme seems simple and straightforward, designing a real-world cloud downloading system involves complicated and subtle trade-offs (between deployment cost and user experience) when serving a large number of users: 1) how to plan the cloud cache capacity to achieve a high and affordable cache hit ratio, 2) how to accelerate the data delivery from the cloud to numerous users, 3) how to handle the dense user requests for highly popular files, and 4) how to judge a potential downloading failure of the cloud. This paper addresses these design trade-offs from a practical perspective, based on big data from a nationwide commercial cloud downloading system, i.e., Tencent QQXuanfeng. Its running traces help us find reasonable design strategies and parameters, and its real performances confirm the efficacy of our design. Our study provides solid experiences and valuable heuristics for the developers of similar and relevant systems. Keywords cloud downloading cost-effective design trade-off big data