基于P2P网络流媒体点播系统的研究
|
摘要
随着Internet网络的快速发展,人们已不再满足于普通的网页、邮件等应用,流媒体应用正在逐渐成为关注的热点,而在流媒体的各项应用中,网络电视备受瞩目。但是流媒体资源数据量大,对服务器的带宽要求高,因此在流媒体点播系统中采用P2P技术势在必行。
本文首先分析了基于P2P网络流媒体点播系统的基本原理,并给出了系统实现的整体架构、工作模式以及工作流程。在此基础上,重点研究了缓存淘汰与替换以及数据调度算法。在本文的最后,结合提出的缓存淘汰与替换以及数据调度算法,实现了基于P2P网络的流媒体点播系统。
在缓存淘汰与替换方面,传统的LRU(最早使用)和LFU(最少使用)算法只考虑了节点自身的缓存情况,并没有考虑整个系统资源的缓存情况。本文提出了基于冗余度的缓存淘汰与替换算法,该算法优先将系统中冗余度高的数据淘汰和替换掉,使得系统中含量较少的数据资源始终保留在有限的缓存空间上,以充分发挥缓存空间的作用,更好地为其他节点提供服务。仿真结果表明基于冗余度的缓存淘汰与替换算法可以大量减轻流媒体服务器的负担。
在数据调度方面,分析了传统的顺序调度算法和最少优先调度算法,本文中提出将顺序调度与最少优先调度结合起来的调度算法,在预选窗口的前面部分采用顺序调度算法以保证播放质量,而在后面部分采用最少优先调度算法,这样可以增加系统中含量少的片断数量,从而更好的为其他节点服务,减轻流媒体服务器的负担。仿真结果显示顺序调度与最少优先调度相结合的调度算法继承了顺序调度与最少优先调度两者的优点,可以在保证一定播放质量的同时减轻流媒体服务器的负担。
With the rapid development of Internet networks, it is no longer satisfied with the ordinary web pages, e-mail applications. Now streaming media applications are increasingly becoming the focus of attention, and in the applications of streaming media, network television concerns a great deal of attention. However, streaming media has large amount of data, and high bandwidth requirements on the server. So in the streaming media system, it is imperative to use P2P technology.
This paper firstly analyzed the basic principle of the streaming media on demand system based on P2P network and gave the architecture, working mode and the working process of the system. On this basis, this paper primary did research on the cache replacement and transmission algorithms. In the end of this paper, combining with the cache replacement and transmission algorithms, the streaming media on demand system based on the P2P network has been implemented.
There are two traditional cache replacement algorithms, one is LRU (Least Recently Used) and the other is LFU (Least Frequently Used). For one single peer, the two algorithms maybe are the best, but they just considered the cache condition of their own. So this paper proposed a cache replacement algorithm which is related to the redundant of the chunks in the system. When the disk cache is full, the chunks having high redundancy rate will first be removed. And the chunks which are less in the system will be kept in the disk cache, so the peer can provide these chunks for other peers. Simulation results show that this cache replacement algorithm can reduce the overhead of the streaming media server.
There are two traditional transmission algorithms, one is sequential and the other is rarest first. The sequential algorithm transmits the chunk one by one according to their playing sequence, this algorithm can keep the video playing fluently. And the rarest first algorithm transmits the chunk first that is the rarest in the system, this algorithm helps speeding up the spread of chunks, hence improves the quality of the whole system. This paper presented a transmission algorithm that combining the sequential and rarest first algorithms. For the emergency chunks, the sequential algorithm will be chose to keep the video play fluently. And for the none emergency chunks, the rarest first algorithm will be chose to make the chunks uniform distribution in the system. Simulation results show that this transmission algorithm can guarantee the video playing fluently and reduce the overhead of the streaming media server.
本文首先分析了基于P2P网络流媒体点播系统的基本原理,并给出了系统实现的整体架构、工作模式以及工作流程。在此基础上,重点研究了缓存淘汰与替换以及数据调度算法。在本文的最后,结合提出的缓存淘汰与替换以及数据调度算法,实现了基于P2P网络的流媒体点播系统。
在缓存淘汰与替换方面,传统的LRU(最早使用)和LFU(最少使用)算法只考虑了节点自身的缓存情况,并没有考虑整个系统资源的缓存情况。本文提出了基于冗余度的缓存淘汰与替换算法,该算法优先将系统中冗余度高的数据淘汰和替换掉,使得系统中含量较少的数据资源始终保留在有限的缓存空间上,以充分发挥缓存空间的作用,更好地为其他节点提供服务。仿真结果表明基于冗余度的缓存淘汰与替换算法可以大量减轻流媒体服务器的负担。
在数据调度方面,分析了传统的顺序调度算法和最少优先调度算法,本文中提出将顺序调度与最少优先调度结合起来的调度算法,在预选窗口的前面部分采用顺序调度算法以保证播放质量,而在后面部分采用最少优先调度算法,这样可以增加系统中含量少的片断数量,从而更好的为其他节点服务,减轻流媒体服务器的负担。仿真结果显示顺序调度与最少优先调度相结合的调度算法继承了顺序调度与最少优先调度两者的优点,可以在保证一定播放质量的同时减轻流媒体服务器的负担。
With the rapid development of Internet networks, it is no longer satisfied with the ordinary web pages, e-mail applications. Now streaming media applications are increasingly becoming the focus of attention, and in the applications of streaming media, network television concerns a great deal of attention. However, streaming media has large amount of data, and high bandwidth requirements on the server. So in the streaming media system, it is imperative to use P2P technology.
This paper firstly analyzed the basic principle of the streaming media on demand system based on P2P network and gave the architecture, working mode and the working process of the system. On this basis, this paper primary did research on the cache replacement and transmission algorithms. In the end of this paper, combining with the cache replacement and transmission algorithms, the streaming media on demand system based on the P2P network has been implemented.
There are two traditional cache replacement algorithms, one is LRU (Least Recently Used) and the other is LFU (Least Frequently Used). For one single peer, the two algorithms maybe are the best, but they just considered the cache condition of their own. So this paper proposed a cache replacement algorithm which is related to the redundant of the chunks in the system. When the disk cache is full, the chunks having high redundancy rate will first be removed. And the chunks which are less in the system will be kept in the disk cache, so the peer can provide these chunks for other peers. Simulation results show that this cache replacement algorithm can reduce the overhead of the streaming media server.
There are two traditional transmission algorithms, one is sequential and the other is rarest first. The sequential algorithm transmits the chunk one by one according to their playing sequence, this algorithm can keep the video playing fluently. And the rarest first algorithm transmits the chunk first that is the rarest in the system, this algorithm helps speeding up the spread of chunks, hence improves the quality of the whole system. This paper presented a transmission algorithm that combining the sequential and rarest first algorithms. For the emergency chunks, the sequential algorithm will be chose to keep the video play fluently. And for the none emergency chunks, the rarest first algorithm will be chose to make the chunks uniform distribution in the system. Simulation results show that this transmission algorithm can guarantee the video playing fluently and reduce the overhead of the streaming media server.
引文
[1]中国互联网络信息中心.中国互联网络发展状况统计报告. 2008, 21
[2]王立鹏,陆际光.浅谈流媒体技术及其基于P2P的应用.电脑知识与技术, 2007, 10: 1109
[3]艾瑞市场咨询有限公司.中国P2P流媒体研究报告. 2007
[4] S. Alstrup, T. Rauhe. Introducing OctoShape– a new technology for large-scale streaming over the Internet. EBU Technical Review, 2005
[5]罗坤,许先斌.安全高效的流媒体服务器集群系统.吉林大学学报(信息科学版), 2006, 24(1): 108-112
[6] Vakali A, Pallis G.. Content delivery networks: Status and trends. IEEE Internet Computing, 2003, 7(6): 68~74
[7] Perlman R. Models for IP multicast. The 12th IEEE International Conference on Networks, 2004, 2: 678-682
[8]吴丽丽. P2P技术浅析.大众科技, 2006, 4: 27-28
[9] EMule. http://www.emule.com/
[10] BitTorrent. http://www.bittorrent.com/
[11] H.Deshpande, M.Bawa, H.Garcia-Molina. Streaming Live Media over Peers. Technical Report in CS-Stanford, 2002,10
[12] PeerCast. http://www.peercast.org/
[13] Xinyan Zhang, Jiangchuan Liu, Bo Li, Tak-Shing Peter Yum. CoolStreaming / DONet: A Data-Driven Overlay Network for Efficient Live Media Streaming. Proc of the IEEE INFOCOM, 2005
[14] Deger Cenk Erdil, Michael J. Lewis. Grid Resource Scheduling with Gossiping Protocols. The Seventh IEEE International Conference on Peer-to-Peer Computing, 2007, 9: 193– 202
[15] PPLive. http://www.pplive.com/
[16]张文,赵子铭,杨天路,魏小康. P2P网络技术原理与C++开发案例.人民邮电出版社, 2008
[17] QQLive. http://www.qqlive.com/
[18] Guo Y, Suh K, Kurose J, et al. P2Cast: peer-to-peer patching scheme for VoD service [A]. Proc of the 12th Int Conf on WorldWideWeb[C], 2003
[19] GridCast. http://www.gridcast.cn/
[20] PPStream. http://www.ppstream.com/
[21]李伟章. P2P技术与应用.电信技术, 2006, 4-108
[22]周文莉,吴晓非. P2P技术综述.计算机工程与设计, 2006, 1: 76-77
[23] Zongming Fei, Mengkun Yang. A segmentation-based fine-grained peer sharing technique for delivering large media files in content distribution networks. IEEE Transactions on Multimedia, 2006, 8(4): 821-829
[24] Pouwelse J A, Garbacki P, Epema D H J. The Bittorrent P2P file-sharing system: Measurements and analysis. Proc of 4th International Workshop on Peer-to-Peer Systems, 2005: 205-216
[25] Delannoy O, Petiton S. A peer to peer computing framework: design and performance evaluation of YML. Parallel and Distributed Computing, 2004, 7: 362–369
[26]李伟章. P2P技术的网络模型与应用.当代通信, 2006, 6: 60-62
[27]方艇.基于P2P技术的局域网即时通讯软件教学设计应用.中国校外教育, 2008, 6: 161
[28] Srinivasa K G, Shashank Hegde, Visweswaran Jayanth, Vivek Khurana. Streaming Audio over a Mesh based Peer to Peer Network Overlay. IEEE the Third International Conference on Convergence and Hybrid Information Technology, 2008: 149-153
[29]张银才.流媒体技术及其应用.有线电视技术, 2009, 3: 38-40
[30]胡淼,汪宁.浅谈流媒体技术.民营科技, 2008, 7: 47
[31]王立鹏,陆际光.浅谈流媒体技术及其基于P2P的应用.电脑知识与技术, 2007, 10: 1109-1126
[32] Gregory J. Conklin, Gary S. Greenbaum, Karl O. Lillevold, Alan F. Lippman,Yuriy A. Reznik. Video coding for streaming media delivery on the Internet. IEEE Transactions on Circuits and Systems for Video Technology, 2001, 11(3): 269-281
[33]黄海滨.流式传输技术探讨.河池师专学报, 2002, 22(4): 93-95
[34]赵勇,曾坷,戴琼海.服务于流媒体的实时传输协议RTP.现代电视技术, 2004, 4: 32-39
[35]尹洪,洪玫,曾明,冷江,王卓.基于RTCP的实时流式传输拥塞控制算法.云南大学学报(自然科学版), 2008, 30(S2): 235-240
[36]许林,白光伟.流控制传输协议传输流媒体性能研究.计算机工程与应用, 2008, 44(1): 112-116
[37] Lan Wang, Andreas Terzis, Lixia Zhang. A new proposal for RSVP refreshes. The Seventh International Conference on Network Protocols, 1999, 11: 163– 172
[38]郑若艇,万健,徐向华. P2P流媒体点播系统的研究与实现.杭州电子科技大学学报, 2007, 27(6)
[39]周卫,叶梧,冯穗力,杨杰.推送模式的P2P流媒体分发算法.科学技术与工程, 2008, 8(4): 946-957
[40] Ganesh.A, Kermarrec.A and Massoulie.L. Peer-to-peer membership management for gossip-based protocols. IEEE Transactions on Computers, 2003, 52(2)
[41] LI Jing, GU Naijie, JIA Weijia. FTALM : an efficient tree structured application layer multicast protocol. JOURNAL OF UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA, 2008, 38(10)
[42]高钒,陈世平.基于P2P网状结构的多源应用层组播系统.计算机应用, 2007, 27(7): 1562-1568
[43] Banerjee S, Bhattacharjee B, Kommareddy C. Scalable application layer multicast. ACM SIGCOMM Computer Communication Review, 2002, 32(4): 205-217.
[44] Gao Wen, Huo Longshe, Fu Qiang. Recent Advances in peer-to-Peer Media Streaming Systems. China Communications, 2006, 10: 52-57
[45] Sujay Sanghavi, Bruce Hajek, Laurent Massoulie. Gossiping With Multiple Messages. IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53(12): 4640-4654
[2]王立鹏,陆际光.浅谈流媒体技术及其基于P2P的应用.电脑知识与技术, 2007, 10: 1109
[3]艾瑞市场咨询有限公司.中国P2P流媒体研究报告. 2007
[4] S. Alstrup, T. Rauhe. Introducing OctoShape– a new technology for large-scale streaming over the Internet. EBU Technical Review, 2005
[5]罗坤,许先斌.安全高效的流媒体服务器集群系统.吉林大学学报(信息科学版), 2006, 24(1): 108-112
[6] Vakali A, Pallis G.. Content delivery networks: Status and trends. IEEE Internet Computing, 2003, 7(6): 68~74
[7] Perlman R. Models for IP multicast. The 12th IEEE International Conference on Networks, 2004, 2: 678-682
[8]吴丽丽. P2P技术浅析.大众科技, 2006, 4: 27-28
[9] EMule. http://www.emule.com/
[10] BitTorrent. http://www.bittorrent.com/
[11] H.Deshpande, M.Bawa, H.Garcia-Molina. Streaming Live Media over Peers. Technical Report in CS-Stanford, 2002,10
[12] PeerCast. http://www.peercast.org/
[13] Xinyan Zhang, Jiangchuan Liu, Bo Li, Tak-Shing Peter Yum. CoolStreaming / DONet: A Data-Driven Overlay Network for Efficient Live Media Streaming. Proc of the IEEE INFOCOM, 2005
[14] Deger Cenk Erdil, Michael J. Lewis. Grid Resource Scheduling with Gossiping Protocols. The Seventh IEEE International Conference on Peer-to-Peer Computing, 2007, 9: 193– 202
[15] PPLive. http://www.pplive.com/
[16]张文,赵子铭,杨天路,魏小康. P2P网络技术原理与C++开发案例.人民邮电出版社, 2008
[17] QQLive. http://www.qqlive.com/
[18] Guo Y, Suh K, Kurose J, et al. P2Cast: peer-to-peer patching scheme for VoD service [A]. Proc of the 12th Int Conf on WorldWideWeb[C], 2003
[19] GridCast. http://www.gridcast.cn/
[20] PPStream. http://www.ppstream.com/
[21]李伟章. P2P技术与应用.电信技术, 2006, 4-108
[22]周文莉,吴晓非. P2P技术综述.计算机工程与设计, 2006, 1: 76-77
[23] Zongming Fei, Mengkun Yang. A segmentation-based fine-grained peer sharing technique for delivering large media files in content distribution networks. IEEE Transactions on Multimedia, 2006, 8(4): 821-829
[24] Pouwelse J A, Garbacki P, Epema D H J. The Bittorrent P2P file-sharing system: Measurements and analysis. Proc of 4th International Workshop on Peer-to-Peer Systems, 2005: 205-216
[25] Delannoy O, Petiton S. A peer to peer computing framework: design and performance evaluation of YML. Parallel and Distributed Computing, 2004, 7: 362–369
[26]李伟章. P2P技术的网络模型与应用.当代通信, 2006, 6: 60-62
[27]方艇.基于P2P技术的局域网即时通讯软件教学设计应用.中国校外教育, 2008, 6: 161
[28] Srinivasa K G, Shashank Hegde, Visweswaran Jayanth, Vivek Khurana. Streaming Audio over a Mesh based Peer to Peer Network Overlay. IEEE the Third International Conference on Convergence and Hybrid Information Technology, 2008: 149-153
[29]张银才.流媒体技术及其应用.有线电视技术, 2009, 3: 38-40
[30]胡淼,汪宁.浅谈流媒体技术.民营科技, 2008, 7: 47
[31]王立鹏,陆际光.浅谈流媒体技术及其基于P2P的应用.电脑知识与技术, 2007, 10: 1109-1126
[32] Gregory J. Conklin, Gary S. Greenbaum, Karl O. Lillevold, Alan F. Lippman,Yuriy A. Reznik. Video coding for streaming media delivery on the Internet. IEEE Transactions on Circuits and Systems for Video Technology, 2001, 11(3): 269-281
[33]黄海滨.流式传输技术探讨.河池师专学报, 2002, 22(4): 93-95
[34]赵勇,曾坷,戴琼海.服务于流媒体的实时传输协议RTP.现代电视技术, 2004, 4: 32-39
[35]尹洪,洪玫,曾明,冷江,王卓.基于RTCP的实时流式传输拥塞控制算法.云南大学学报(自然科学版), 2008, 30(S2): 235-240
[36]许林,白光伟.流控制传输协议传输流媒体性能研究.计算机工程与应用, 2008, 44(1): 112-116
[37] Lan Wang, Andreas Terzis, Lixia Zhang. A new proposal for RSVP refreshes. The Seventh International Conference on Network Protocols, 1999, 11: 163– 172
[38]郑若艇,万健,徐向华. P2P流媒体点播系统的研究与实现.杭州电子科技大学学报, 2007, 27(6)
[39]周卫,叶梧,冯穗力,杨杰.推送模式的P2P流媒体分发算法.科学技术与工程, 2008, 8(4): 946-957
[40] Ganesh.A, Kermarrec.A and Massoulie.L. Peer-to-peer membership management for gossip-based protocols. IEEE Transactions on Computers, 2003, 52(2)
[41] LI Jing, GU Naijie, JIA Weijia. FTALM : an efficient tree structured application layer multicast protocol. JOURNAL OF UNIVERSITY OF SCIENCE AND TECHNOLOGY OF CHINA, 2008, 38(10)
[42]高钒,陈世平.基于P2P网状结构的多源应用层组播系统.计算机应用, 2007, 27(7): 1562-1568
[43] Banerjee S, Bhattacharjee B, Kommareddy C. Scalable application layer multicast. ACM SIGCOMM Computer Communication Review, 2002, 32(4): 205-217.
[44] Gao Wen, Huo Longshe, Fu Qiang. Recent Advances in peer-to-Peer Media Streaming Systems. China Communications, 2006, 10: 52-57
[45] Sujay Sanghavi, Bruce Hajek, Laurent Massoulie. Gossiping With Multiple Messages. IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53(12): 4640-4654