基于P2P的流媒体系统研究与实现
摘要
随着网络技术的的日益发展,人们的生活中越来越离不开Internet,全球的电信运营商也将目光集中在宽带网上的各类增值业务。其中,基于流媒体技术的IPTV服务有着广阔的应用前景。传统的IPTV服务采用的是客户机/服务器(C/S)结构,随着用户数量的增加,服务器的负载越来越重,而服务器本身的处理能力和带宽有限,因此容易造成“单点实效”,系统的可扩展性差。P2P技术不同于以服务器为中心的C/S传输模式,其采用的是对等网络模式:网络中的节点即可以获取其他节点的资源,又充当服务器为其他节点提供资源。这种模式将服务由中心推向了边缘,充分利用网络中各节点的资源,极大减轻了系统服务器的负载,这些特点都极大促进了基于P2P的流媒体系统特别是IPTV的应用和发展。
本文首先介绍了P2P三代网络体系结构,技术特点及流媒体相关方面知识。其次,重点分析了Bittorrent系统组成及其协议,并根据流媒体传输的特点,对Bittorrent的部分算法进行改进。最后结合Bittorrent协议,将传统的IPTV系统中的内容分发网络(CDN)模式和P2P进行有效融合,设计了一种适合部署和运营的P2P结构的IPTV系统,有效解决了原IPTV系统的扩展性差、资源利用率低和系统吞吐性能不高等问题。同时,为实现系统的跨平台运行以及往机顶盒上移植,系统使用跨平台的ACE网络库编写,可以支持Linux、Windows、Solaris等系统。
With the development of network,Internet become one part of our life gradually.More and more Telecom service providers around the world pay attention to the value-added service.Especially the service of IPTV which base on streaming has a brighter future. In the past,the service of IPTV adopt the standard structure of C/S (Client/Server) .The structure of C/S has a fatal limitation that likely to get overloaded and has a single point of effectiveness which affected by the limitative processing capability of server and the bandwidth.The structure of Peer-to-Peer changes the mode of server-centric and makes every Peer equivalent in the network. Every Peer offers service for other Peers at the same time enjoys the services provided by other Peers. So IPTV based on P2P solve the problem of traditional IPTV service, and greatly boosts the application and development of IPTV.
This paper recommends the anciently structure and technic character of P2P and the knowledge of streaming firstly. Then focus on the system composition and the protocol of Bittorrent. Then improve the piece-picker arithmetic of Bittorrent according to the feature of streaming. Ultimately unify the merit of traditional Content Distribution Network and P2P, produces an IPTV system great at deployment and operation. For the sake of transplanting to the set-top box, the system base on ACE that support for Linux, Windows, Solaris systems.
本文首先介绍了P2P三代网络体系结构,技术特点及流媒体相关方面知识。其次,重点分析了Bittorrent系统组成及其协议,并根据流媒体传输的特点,对Bittorrent的部分算法进行改进。最后结合Bittorrent协议,将传统的IPTV系统中的内容分发网络(CDN)模式和P2P进行有效融合,设计了一种适合部署和运营的P2P结构的IPTV系统,有效解决了原IPTV系统的扩展性差、资源利用率低和系统吞吐性能不高等问题。同时,为实现系统的跨平台运行以及往机顶盒上移植,系统使用跨平台的ACE网络库编写,可以支持Linux、Windows、Solaris等系统。
With the development of network,Internet become one part of our life gradually.More and more Telecom service providers around the world pay attention to the value-added service.Especially the service of IPTV which base on streaming has a brighter future. In the past,the service of IPTV adopt the standard structure of C/S (Client/Server) .The structure of C/S has a fatal limitation that likely to get overloaded and has a single point of effectiveness which affected by the limitative processing capability of server and the bandwidth.The structure of Peer-to-Peer changes the mode of server-centric and makes every Peer equivalent in the network. Every Peer offers service for other Peers at the same time enjoys the services provided by other Peers. So IPTV based on P2P solve the problem of traditional IPTV service, and greatly boosts the application and development of IPTV.
This paper recommends the anciently structure and technic character of P2P and the knowledge of streaming firstly. Then focus on the system composition and the protocol of Bittorrent. Then improve the piece-picker arithmetic of Bittorrent according to the feature of streaming. Ultimately unify the merit of traditional Content Distribution Network and P2P, produces an IPTV system great at deployment and operation. For the sake of transplanting to the set-top box, the system base on ACE that support for Linux, Windows, Solaris systems.
引文
[1]Napster.http://www.napster.com
[2]Guntella.http://www.gnutella.com
[3]KaZaa.http://www.kazza.com
[4]BitTorrent.http://www.bittorrent.com
[5]eDonkey,http://www.edonkey2000.com
[6]ZHANG Xinyan,LIU Jiangchuan,LI Bo,et al.CoolStreaming/DONet:a data-driven overlay network for peer-to-peer live media streaming[C][M].Proceedings of 24th Annual Joint Conference of the IEEE Computer and Communications SocietiesMarl 3-17.2005年
[7]iResearch Consulting Group.China p2p streaming research report[R][M].2007
[8]LIU J C,RAO S,LI B,et al.Opportunities and challenges of peer-to-peer Internet video broadcast[J][M].Proceedings of the IEEE,Special Issue on Recent Advances in Distributed Multimedia Communications.2007
[9]邢小良,张新建.P2P技术带给宽带接入网的挑战与发展机遇[J].电信技术.2006年08期
[10]韦乐平.三网融合与IPTV的发展和挑战[J].电信科学.2006年07期
[11]何晓华.P2P技术在IPTV中的应用[J].中国有线电视.2006,(12)
[12]CJENG B,LIU X,ZHANG Z,et al.A measurement study of a peer-to-peer video-on-demand system[C][M].Proceedings of 6th International Workshop on Peer-to-Peer Systems,Feb26-27,2007
[13]魏亮,尹培生.P2P给电信行业带来的思考[J].电信科学.2006,(09)
[14]GUO Y,SUH K,KUROSE J,et al.A peer-to-peer on-demand streaming service and its performance evaluation[C][M].Proceedings of 2003IEEE International Conference on Multimedia&Expo(ICME2003)July6-9,2003
[15]汤晟,吴朝晖.P2P—对等网络的未来[J].计算机应用研究.2004,(01)
[16]林宇,程时端,李琦.对等网络[J].中兴通讯技术.2006,(02)
[17]Proiect JXTA.JXTA Protocols Specification[DB/OL].http://www.ixta.org.2007
[18]雷葆华,杨明川.p2p技术的组网模式与业务模式探讨[J].电信技术,2004年11期
[19]Microsoft.Introduction to Windows Peer-to-Peer Networking[EB/OL].2004.07.
[20]宿兴华.基于P2P的视频下载系统的设计与实现[D].浙江大学,2007
[21]邓江.基于P2P的内容分发网络体系结构及路由研究[D].电子科技大学,2007
[22]邓祖明.P2P搜索技术研究[D].电子科技大学,2007
[23]王守彦.基于P2P网络的流媒体直播系统的设计与实现[D].大连理工大学,2006
[24]李婷婷.基于P2P模式的媒体服务研究[D].北京邮电大学,2005
[25]梁泠霞.基于QoS带宽管理技术的P2P流量控制研究及其实现[D].天津大学,2006
[26]李佳洁.P2P流媒体系统的研究与实现[D].北京交通大学,2006
[27]王银江.基于P2P网络媒体直播系统的研究与实现[D].复旦大学,2005
[28]吴国勇,邱学刚,万燕仔编著.网络视频流媒体技术与应用[M].北京邮电大学出版社,2001
[29]毕野.基于Microsoft Producer和Windows Media技术制作和发布流媒体网络课件[D].淮海工学院,2006
[30]曹燕萍,谢剑英.Windows流媒体技术及其应用[J].计算机工程.2002,28(8):6-8
[31]张江荣,张江南.基于Web的教学系统中的流媒体实时传输技术[J].信息技术,2004,28(9):10-13
[32]王展明.BitTorrent原理与算法研究及其性能优化[D].南昌大学,2007
[33]程磊,陈鸣,周骏.对BitTorrent通信协议的分析与检测[J].电信科学,2006,(12)
[34]聂哲.BitTorrent技术探讨与性能改进[J].现代计算机,2007,(06)
[35]罗丹.BT流识别和特征分析[D].北京交通大学,2007
[36]孔亮.基于P2P的局域网文件共享系统研究与设计[D].哈尔滨工业大学,2006
[37]Tomcat.http://tomcat.apache.org
[38]MySQL.http://www.mysql.org
[39]Eclipse.http://www.eclipse.org
[40]刘名博.移动增值业务综合管理平台关键技术的研究[D].北京邮电大学,2007
[41]LUA K,CROWCROFT J,PIAS M,et al.A survey and compari-son of peer-to-peer overlay network schemes[J][M].IEEE Communications Survey and Tutorial.2005
[42]Silverston T,Fourmaux O.Source vs data-driven approach for live P2P streaming networking.International Conference on Systems and International Conference on Mobile Communications and Learning Technologies.Mauritius:IEEE.2006.99-99
[43]Hefeeda M,Habib A,Botev B,et al.PROMISE:a peer-to-peer media streaming using collect cast.Proc of the ACMMultimedia.New York:ACM,2003,:45-54
[44]Tran K,Hua TD.Zigzag.An efficient peer-to-peer scheme for media streaming.IEEE INFOCOM.San Francisco,CA,USA.IEEE,2003.1283-1292
[45]Guo Y,Suh K,Kuroee J.P2Cast:peer-to-peer patching scheme for VoD service.Journal of Public Economics,2003,(11):56-59
[46]Davey.R,Kani.J,Bourgart.F,McCammon.K.Options for future optical access networks.Communications Magazine,IEEE Volume 44,Issue 10,October 2006 Page(s):50-56
[47]韦乐平.光纤通信技术的发展与展望[J].电信技术.2006.11
[48]侯自强.发展IPTV应该关注的几个问题[J].世界电信.2006,19(2):30-32
[49]孙波.IPTV的组网及关键技术分析[J].中国有线电视.2006
[2]Guntella.http://www.gnutella.com
[3]KaZaa.http://www.kazza.com
[4]BitTorrent.http://www.bittorrent.com
[5]eDonkey,http://www.edonkey2000.com
[6]ZHANG Xinyan,LIU Jiangchuan,LI Bo,et al.CoolStreaming/DONet:a data-driven overlay network for peer-to-peer live media streaming[C][M].Proceedings of 24th Annual Joint Conference of the IEEE Computer and Communications SocietiesMarl 3-17.2005年
[7]iResearch Consulting Group.China p2p streaming research report[R][M].2007
[8]LIU J C,RAO S,LI B,et al.Opportunities and challenges of peer-to-peer Internet video broadcast[J][M].Proceedings of the IEEE,Special Issue on Recent Advances in Distributed Multimedia Communications.2007
[9]邢小良,张新建.P2P技术带给宽带接入网的挑战与发展机遇[J].电信技术.2006年08期
[10]韦乐平.三网融合与IPTV的发展和挑战[J].电信科学.2006年07期
[11]何晓华.P2P技术在IPTV中的应用[J].中国有线电视.2006,(12)
[12]CJENG B,LIU X,ZHANG Z,et al.A measurement study of a peer-to-peer video-on-demand system[C][M].Proceedings of 6th International Workshop on Peer-to-Peer Systems,Feb26-27,2007
[13]魏亮,尹培生.P2P给电信行业带来的思考[J].电信科学.2006,(09)
[14]GUO Y,SUH K,KUROSE J,et al.A peer-to-peer on-demand streaming service and its performance evaluation[C][M].Proceedings of 2003IEEE International Conference on Multimedia&Expo(ICME2003)July6-9,2003
[15]汤晟,吴朝晖.P2P—对等网络的未来[J].计算机应用研究.2004,(01)
[16]林宇,程时端,李琦.对等网络[J].中兴通讯技术.2006,(02)
[17]Proiect JXTA.JXTA Protocols Specification[DB/OL].http://www.ixta.org.2007
[18]雷葆华,杨明川.p2p技术的组网模式与业务模式探讨[J].电信技术,2004年11期
[19]Microsoft.Introduction to Windows Peer-to-Peer Networking[EB/OL].2004.07.
[20]宿兴华.基于P2P的视频下载系统的设计与实现[D].浙江大学,2007
[21]邓江.基于P2P的内容分发网络体系结构及路由研究[D].电子科技大学,2007
[22]邓祖明.P2P搜索技术研究[D].电子科技大学,2007
[23]王守彦.基于P2P网络的流媒体直播系统的设计与实现[D].大连理工大学,2006
[24]李婷婷.基于P2P模式的媒体服务研究[D].北京邮电大学,2005
[25]梁泠霞.基于QoS带宽管理技术的P2P流量控制研究及其实现[D].天津大学,2006
[26]李佳洁.P2P流媒体系统的研究与实现[D].北京交通大学,2006
[27]王银江.基于P2P网络媒体直播系统的研究与实现[D].复旦大学,2005
[28]吴国勇,邱学刚,万燕仔编著.网络视频流媒体技术与应用[M].北京邮电大学出版社,2001
[29]毕野.基于Microsoft Producer和Windows Media技术制作和发布流媒体网络课件[D].淮海工学院,2006
[30]曹燕萍,谢剑英.Windows流媒体技术及其应用[J].计算机工程.2002,28(8):6-8
[31]张江荣,张江南.基于Web的教学系统中的流媒体实时传输技术[J].信息技术,2004,28(9):10-13
[32]王展明.BitTorrent原理与算法研究及其性能优化[D].南昌大学,2007
[33]程磊,陈鸣,周骏.对BitTorrent通信协议的分析与检测[J].电信科学,2006,(12)
[34]聂哲.BitTorrent技术探讨与性能改进[J].现代计算机,2007,(06)
[35]罗丹.BT流识别和特征分析[D].北京交通大学,2007
[36]孔亮.基于P2P的局域网文件共享系统研究与设计[D].哈尔滨工业大学,2006
[37]Tomcat.http://tomcat.apache.org
[38]MySQL.http://www.mysql.org
[39]Eclipse.http://www.eclipse.org
[40]刘名博.移动增值业务综合管理平台关键技术的研究[D].北京邮电大学,2007
[41]LUA K,CROWCROFT J,PIAS M,et al.A survey and compari-son of peer-to-peer overlay network schemes[J][M].IEEE Communications Survey and Tutorial.2005
[42]Silverston T,Fourmaux O.Source vs data-driven approach for live P2P streaming networking.International Conference on Systems and International Conference on Mobile Communications and Learning Technologies.Mauritius:IEEE.2006.99-99
[43]Hefeeda M,Habib A,Botev B,et al.PROMISE:a peer-to-peer media streaming using collect cast.Proc of the ACMMultimedia.New York:ACM,2003,:45-54
[44]Tran K,Hua TD.Zigzag.An efficient peer-to-peer scheme for media streaming.IEEE INFOCOM.San Francisco,CA,USA.IEEE,2003.1283-1292
[45]Guo Y,Suh K,Kuroee J.P2Cast:peer-to-peer patching scheme for VoD service.Journal of Public Economics,2003,(11):56-59
[46]Davey.R,Kani.J,Bourgart.F,McCammon.K.Options for future optical access networks.Communications Magazine,IEEE Volume 44,Issue 10,October 2006 Page(s):50-56
[47]韦乐平.光纤通信技术的发展与展望[J].电信技术.2006.11
[48]侯自强.发展IPTV应该关注的几个问题[J].世界电信.2006,19(2):30-32
[49]孙波.IPTV的组网及关键技术分析[J].中国有线电视.2006