A Subscription Overlay Network for Large-Scale and Efficient File Parallel Downloading

详细信息    查看全文

• 关键词：Subscription ; based overlay networks ; File parallel downloading ; Idling nodes
• 刊名：Lecture Notes in Computer Science
• 出版年：2015
• 出版时间：2015
• 年：2015
• 卷：9334
• 期：1
• 页码：210-218
• 全文大小：591 KB
• 参考文献：1.FileZilla Server. http://​filezilla-project.​org/​download.​php?​type=​server
  2.Ns-3. http://​www.​nsnam.​org
  3.Al-Jaroodi, J., Mohamed, N.: Ddftp: dual-direction ftp. In: Proceedings of the International Symposium on Cluster, Cloud and Grid Computing, pp. 504–513 (2011)
  4.Bernstein, D.J.: Pipeling. http://​cr.​yp.​to/​ftp/​pipeling
  5.Byers, J.W., Luby, M., Mitzenmacher, M.: Accessing multiple mirror sites in parallel: using tornado codes to speed up downloads. In: Proceedings of IEEE International Conference on Computer Communications, pp. 275–283, 21–25 March 1999
  6.Chang, R.S., Guob, M.H., Lina, H.C.: A multiple parallel download scheme with server throughput and client bandwidth considerations for data grids. Future Gener. Comput. Syst. 24(8), 798–805 (2008)CrossRef
  7.Chen, H., Gong, Z., Huang, Z.: Parallel downloading algorithm for large-volume file distribution. In: Proceedings of the 6th International Conference on Parallel and Distributed Computing, Applications and Technologies, pp. 745–749, December 2005
  8.Feldman, M., Lai, K., Stoica, I., Chuang, J.: Robust incentive techniques for peer-to-peer networks. In: Proceedings of the Conference on Electronic Commerce, pp. 102–111 (2004)
  9.Funasaka, J., Nakawaki, N., Ishida, K., Amano, K.: A parallel downloading method of coping with variable bandwidth. In: Proceedings of the IEEE ICDCS Workshop on Assurance in Distributed Systems and Networks, pp. 14–19, 19–22 May 2003
  10.Galdames, P., Zheng, Q., Cai, Y.: A subscription overlay network for large-scale and cost-efficient any source multicast. In: Proceedings of the IEEE on Performance Computing and Communications Conference, pp. 1–8, 17–19 November 2011
  11.Gkantsidis, C., Ammar, M., Zegura, E.: On the effect of large-scale deployment of parallel downloading. In: IEEE Workshop on Internet Applications, pp. 79–90, 23–24 June 2003
  12.Kolodner, E.K., Tal, S., Kyriazis, D., et al.: A cloud environment for data-intensive storage service. In: Proceedings of the International Conference on Cloud Computing Technology and Science, pp. 357–366, 29 November - 1 December 2011
  13.Koo, M., Rosenberg, C., Dongyan, X.: Analysis of parallel downloading for large file distribution. In: Workshop on Future Trends of Distributed Computing Systems, pp. 128–135, 28–30 May 2003
  14.Koo, S., Lee, C., Kannan, K.: A genetic-algorithm-based neighbor-selection strategy for hybrid peer-to-peer networks. In: Proceedings of the International Conference on Computer Communications and Networks, pp. 469–474 (2004)
  15.Kurose, F., Ross, K.: Computer Networking: A Top-Down Approach, 6th edn. Pearson, US (2012)
  16.Kuznetsov, A.: Tracepath. http://​linux.​die.​net/​man/​8/​tracepath
  17.Lai, K., Feldman, M., Stoica, I., Chuang, J.: Incentives for cooperation in peer-to-peer networks. In: Workshop on Economics of Peer-to-Peer Systems (2003)
  18.Li, J.: Erasure resilient codes in peer-to-peer storage cloud. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, 14–19 May 2006
  19.Lv, Q., Cao, P., Cohen, E., Li, K., Shenker, S.: Search and replication in unstructured peer-to-peer networks. In: Proceedings of ACM International Conference on Supercomputing, New York City, NY, U.S.A, 22–26 June 2002
  20.Ning, K., Zhou, Z., Zhang, L.J.: Leverage personal cloud storage services to provide shared storage for team collaboration. In: Proceedings of the International Conference on Services Computing, pp. 613–620, 27 June - 2 July 2014
  21.Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable content-addressable network. In: Proceedings of ACM SIGCOMM, pp. 161–172, San Diego, CA, U.S.A (2001)
  22.Rodriguez, P., Kirpal, A., Biersack, E.: Parallel-access for mirror sites in the internet. In: Proceedings of the IEEE on Computer Communications, pp. 864–873 (2000)
  23.Sohail, S., Jha, S., Kanhere, S., Chun, T.: Qos driven parallelization of resources to reduce file download delay. IEEE Trans. Parallel Distrib. Syst. 17, 12 (2006)
  24.Stoica, I., Morris, R., Karger, D., Kaashock, M., Balakrishman, H.: Chord: a scalable peer-to-peer lookup protocol for internet applications. In: Proceedings of ACM SIGCOMM, pp. 149–160. San Diego, CA, U.S.A (2001)
  25.Zhang, Z.L.: Feel free to cache: towards an open cdn architecture for cloud-based content distribution. In: Proceedings of the International Conference on Collaboration Technologies and Systems, pp. 488–490, 19–23 May 2014
  26.Zinner, T., Tutschku, K., Nakao, A., Tran-Gia, P.: Using concurrent multipath transmission for transport virtualization: analyzing path selection. In: International Teletraffic Congress, pp. 1–7. IEEE (2010)
  
• 作者单位：Patricio Galdames (17)
  Claudio Gutierrez-Soto (17)
  Cristopher Barrientos (17)
  
  17. Departamento de Sistemas de Informacion, Universidad del Bio-Bio, Av. Ignacio Collao 1202, Concepcion, Chile
  
• 丛书名：Collaboration and Technology
• ISBN：978-3-319-22747-4
• 刊物类别：Computer Science
• 刊物主题：Artificial Intelligence and Robotics
  Computer Communication Networks
  Software Engineering
  Data Encryption
  Database Management
  Computation by Abstract Devices
  Algorithm Analysis and Problem Complexity
  
• 出版者：Springer Berlin / Heidelberg
• ISSN：1611-3349

文摘

This paper presents a subscription-based overlay network that supports file parallel downloading for cloud collaboration. First, our system lets users to register to a central server and allows this server to incrementally build a topology graph containing the network connections among the subscribers. With this topology graph in place, we plan to address the challenges of minimizing network traffic and choosing the best set of nodes storing a chosen file for parallel downloading. When a subscriber wants to access a chosen file stored in the cloud, our system obtains for her a list of nodes having this file. Nodes in this list, are sorted considering both their network distance to the subscriber and their workloads. Second, selecting those top nodes, a bandwidth-aware parallel downloading technique is executed. Finally, our proposed system also features leveraging idling nodes for file downloading. More specifically, the subscribers who are on-line but not participating in downloading are recruited to reduce both network traffic and average latency.