基于DSP的流媒体播放终端的研究与实现
摘要
随着多媒体技术、计算机网络与通信技术的快速发展,流媒体应用在互联网应用中扮演越来越重要的角色,网络视频、视频监控等应用一直处于高速增长。嵌入式流媒体终端具有成本低廉、功耗低等特点,具有广泛的应用。
本文研究开发了一套流媒体播放终端。流媒体播放终端的硬件平台选用基于TI达芬奇技术的OMAP3530处理器平台。在OMAP3530平台上移植了一个嵌入式Linux系统。基于开源多媒体框架Gstreamer开发了终端的各个Gstreamer元件和应用软件。服务器和终端之间采用UDP协议,以组播方式进行通信。系统选用MPEG-4技术进行视频的编解码。通过对MPEG-4编码视频流的封包进行拆包重组,系统很好地解决了在不可靠网络环境中视频数据流的丢包、丢帧问题。针对移动互联要求,在终端系统上移植了无线模块,使得该系统不受有线网络网线的束缚,增加了该系统的实用性。
测试结果表明,该流媒体播放终端能实现视频信号的实时流媒体播放,并且允许多个客户端的随时接入,达到了预期设计目标。
With the rapid development of multimedia technology and computer networks and communication technology, streaming media applications is playing a more and more important role in internet applications. Network multimedia applications and video surveillance are developing rapidly. Embedded streaming media terminals have feature of low cost, low power consumption, it has a wide range of applications.
In this paper, a streaming media player is designed. TI Davinci Technology based OMAP3530 processor is used as the hardware platform. An embedded Linux system is ported on the player platform. Gstreamer elements and a Gstreamer application are developed in the open source multimedia framework Gstreamer. The server and the client communicates using UDP protocol and muticast. The MPEG-4 codec is used as the video codec of the system. By unpacking and recombinanting the packed MPEG-4 encoded video stream, packet loss and frame loss that are on the unreliable protocol are well solved. For the request of mobility, a wireless module is added to the terminal, so the client system is not limited to the wired network, this makes the terminal more useful .
The test results show that the player can play streaming video in real time, and multiple clients can access to the streaming media system at any time. It fulfills the design specification.
本文研究开发了一套流媒体播放终端。流媒体播放终端的硬件平台选用基于TI达芬奇技术的OMAP3530处理器平台。在OMAP3530平台上移植了一个嵌入式Linux系统。基于开源多媒体框架Gstreamer开发了终端的各个Gstreamer元件和应用软件。服务器和终端之间采用UDP协议,以组播方式进行通信。系统选用MPEG-4技术进行视频的编解码。通过对MPEG-4编码视频流的封包进行拆包重组,系统很好地解决了在不可靠网络环境中视频数据流的丢包、丢帧问题。针对移动互联要求,在终端系统上移植了无线模块,使得该系统不受有线网络网线的束缚,增加了该系统的实用性。
测试结果表明,该流媒体播放终端能实现视频信号的实时流媒体播放,并且允许多个客户端的随时接入,达到了预期设计目标。
With the rapid development of multimedia technology and computer networks and communication technology, streaming media applications is playing a more and more important role in internet applications. Network multimedia applications and video surveillance are developing rapidly. Embedded streaming media terminals have feature of low cost, low power consumption, it has a wide range of applications.
In this paper, a streaming media player is designed. TI Davinci Technology based OMAP3530 processor is used as the hardware platform. An embedded Linux system is ported on the player platform. Gstreamer elements and a Gstreamer application are developed in the open source multimedia framework Gstreamer. The server and the client communicates using UDP protocol and muticast. The MPEG-4 codec is used as the video codec of the system. By unpacking and recombinanting the packed MPEG-4 encoded video stream, packet loss and frame loss that are on the unreliable protocol are well solved. For the request of mobility, a wireless module is added to the terminal, so the client system is not limited to the wired network, this makes the terminal more useful .
The test results show that the player can play streaming video in real time, and multiple clients can access to the streaming media system at any time. It fulfills the design specification.
引文
[1]中国互联网络发展状况统计报告[EB/OL]. 2011 http://www.cnnic.net.cn/dtygg/dtgg/201101/P020110119328960192287.pdf
[2]孟凡飞.基于Gstreamer的嵌入式流媒体系统的研究与实现[D].广州:华南理工大学, 2010
[3]刘易,李太君. 3G移动终端流媒体播放技术的研究[J].通信技术, 2011, 44(03): 123-128
[4]谷吉芳.基于Davinci平台的数字视频监控系统的关键问题研究[D].长沙:湖南大学, 2008
[5]流媒体技术的应用与发展[EB/OL]. 2005 http://tech.c114.net/167/a144686.html
[6]王衍斌:初识流媒体[J].中国电子商务, 2001, (23):60-61 http://club.tech.sina.com.cn/viewthread.php?tid=121598&page=1#pid829361
[7]段艳红.流媒体技术的应用与发展[J].天津通信技术, 2004, (04):44-45
[8]邹鑫馨.基于3D-DCT的视频编码实现[D].成都:电子科技大学, 2009
[9]舒予.基于H.264的码率控制算法研究[D].武汉:武汉理工大学, 2008
[10]刘达,龚建荣. MPEG-4:新一代多媒体数据压缩编码国际标准[J].电子设计应用, 2003, (08): 10-25
[11]何智玲,唐泽鹏.基于对象的视频编码方法——MPEG-4[J].中国有线电视, 2002, (23): 49-53
[12]刘达,毛加轩. MPEG-4视频编码核心思想及关键技术研究[J].中国数据通信, 2004, 6(01):102-108
[13] ISO/IEC 14496-2. Information Technology: Coding of Audio-Visual Objects-Part2:Visual[S]. Sydney: ISO/IEC JTC, 2001
[14]吴宝春. ASIC-MP4V_VID——MPEG4 ASP标准理解[EB/OL]. http://read.pudn.com/downloads138/ebook/591564/MPEG4_ASP(chn).pdf
[15]余兆明,李晓飞. MPEG标准及其应用[M].北京:北京邮电大学出版社, 2002:189-201
[16]甘刚. Linux/UNIX网络编程[M].北京:中国水利水电出版社, 2008:3-5
[17]宋明.无线网络视频传输系统的研究与实现[D].北京:北京交通大学, 2007
[18] Comer D E. Internetworking with TCP/IP[M]. Prentice Hall, Inc. 1999:109-120
[19] RFC3550. RTP:A Transport Protocol for Real-Time Applications[S]. IETF Network Working Group, 2003
[20]李小平,刘玉树.多媒体通信技术[M].北京:北京航空航天大学出版社, 2004: 266-267,271-272
[21] HalSall Fred.多媒体通信[M].北京:人民邮电出版社, 2004: 576-579
[22]孙宇.基于IPV6组播技术的VOD系统设计与实现[D].北京:北京邮电大学, 2008
[23]钟玉琢,向哲,沈洪.流媒体和视频服务器[M].北京:清华大学出版社, 2003:54-55
[24]戴俊.嵌入式实时流媒体服务器的实现.广州:华南理工大学, 2010
[25] Lu Qiming. DirectShow- a technical introduction[EB/OL]. http://www.programsalon.com/downloads74/ebook/detail264507.html,2007-4
[26]张睿萍.基于DirectShow的数字视频监控系统的研究与实现[D].武汉:武汉理工大学, 2008
[27]周彪.网络视频监控系统的研究和开发[D].吉林:吉林大学, 2007.
[28] DirectShow[EB/OL]. http://msdn.microsoft.com/en-us/library/ms783323(VS.85).aspx
[29] What is Gstreamer[EB/OL]. http://gstreamer.freedesktop.org/features/index.html
[30] Taymans W, Baker S, Wingo A. Gstreamer Application Development Manual[M/OL]. http://gstreamer.freedesktop.org/data/doc/gstreamer/head/manual/html/index.html
[31] Katafiasz M. Multipurpose Multimedia processing with Gstreamer. http://www.ibm.com/developerworks/aix/library/au-gstreamer.html?S_TACT=105AGX52&S_CMP=cn-a-aix, 2006-7
[32] part-overview[EB/OL]. http://dev.laptop.org/~mstone/sources/expanded_srpms/gstreamer-0.10.12-1.olpc2/gstreamer-0.10.12/docs/design/part-overview.txt
[33]肖文鹏.用Gstreamer简化Linux多媒体开发[EB/OL]. http://www.ibm.com/developerworks/cn/linux/l-gstreamer/index.html, 2004
[34] Boulton R.J, Walthinsen E, Baker S. Gstreamer Plugin Writer’s Guide[M/OL]. http://gstreamer.freedesktop.org/data/doc/gstreamer/head/pwg/html/index.html
[35]一步一步创建Gstreamer插件[EB/OL]. http://www.cnblogs.com/newgreen/archive/2010/12/14/1905246.html
[36] OMAP3530/25 Applications Processor[EB/OL]. http://www.ti.com/cn/lit/gpn/omap3530
[37]深圳市天漠科技有限公司. DEVKIT8000评估套件[EB/OL]. http://www.timll.com/chinese/uploadFile/TIOP/DevKit8000_Overview_CN.pdf
[38] Bhattacharya Rishi. DSP video processing via open-sourceAPIs[EB/OL]. http://www.eetimes.com/design/signal-processing-dsp/4004620/DSP-video-processing-via-open-sourceAPIs, 2006-10
[39] Davinci技术[EB/OL]. http://focus.ti.com.cn/cn/general/docs/gencontent.tsp?contentId=24809&DCMP=TI-cn_Hm_Brand_Tracking&HQS=v%83+OT+home_bc_davinci
[40]张起贵,张胜,张刚.最新DSP技术——“达芬奇”系统、框架和组件[M].北京:国防工业出版社, 2009: 143-170
[41] Codec Engine[EB/OL]. http://processors.wiki.ti.com/index.php/Codec_Engine
[42] Codec Engine Roles[EB/OL]. http://processors.wiki.ti.com/index.php/Codec_Engine_Roles
[43] TI Gstreamer DMAI Plug-In for DaVinci and OMAP Processors[EB/OL]. http://focus.ti.com/docs/toolsw/folders/print/gstreamer.html
[44] Gstreamer Plug-ins for TI hardware[EB/OL]. http://processors.wiki.ti.com/index.php/GStreamer
[45] Gstreamer on TI Davinci and OMAP[EB/OL]. https://gstreamer.ti.com/gf/project/gstreamer_ti/
[46] DVEVM and DVSDK overview[EB/OL]. http://processors.wiki.ti.com/index.php/DVEVM_and_DVSDK_overview
[47] ranlink RT2870[EB/OL]. http://www.ralinktech.com/product.php?s=23
[2]孟凡飞.基于Gstreamer的嵌入式流媒体系统的研究与实现[D].广州:华南理工大学, 2010
[3]刘易,李太君. 3G移动终端流媒体播放技术的研究[J].通信技术, 2011, 44(03): 123-128
[4]谷吉芳.基于Davinci平台的数字视频监控系统的关键问题研究[D].长沙:湖南大学, 2008
[5]流媒体技术的应用与发展[EB/OL]. 2005 http://tech.c114.net/167/a144686.html
[6]王衍斌:初识流媒体[J].中国电子商务, 2001, (23):60-61 http://club.tech.sina.com.cn/viewthread.php?tid=121598&page=1#pid829361
[7]段艳红.流媒体技术的应用与发展[J].天津通信技术, 2004, (04):44-45
[8]邹鑫馨.基于3D-DCT的视频编码实现[D].成都:电子科技大学, 2009
[9]舒予.基于H.264的码率控制算法研究[D].武汉:武汉理工大学, 2008
[10]刘达,龚建荣. MPEG-4:新一代多媒体数据压缩编码国际标准[J].电子设计应用, 2003, (08): 10-25
[11]何智玲,唐泽鹏.基于对象的视频编码方法——MPEG-4[J].中国有线电视, 2002, (23): 49-53
[12]刘达,毛加轩. MPEG-4视频编码核心思想及关键技术研究[J].中国数据通信, 2004, 6(01):102-108
[13] ISO/IEC 14496-2. Information Technology: Coding of Audio-Visual Objects-Part2:Visual[S]. Sydney: ISO/IEC JTC, 2001
[14]吴宝春. ASIC-MP4V_VID——MPEG4 ASP标准理解[EB/OL]. http://read.pudn.com/downloads138/ebook/591564/MPEG4_ASP(chn).pdf
[15]余兆明,李晓飞. MPEG标准及其应用[M].北京:北京邮电大学出版社, 2002:189-201
[16]甘刚. Linux/UNIX网络编程[M].北京:中国水利水电出版社, 2008:3-5
[17]宋明.无线网络视频传输系统的研究与实现[D].北京:北京交通大学, 2007
[18] Comer D E. Internetworking with TCP/IP[M]. Prentice Hall, Inc. 1999:109-120
[19] RFC3550. RTP:A Transport Protocol for Real-Time Applications[S]. IETF Network Working Group, 2003
[20]李小平,刘玉树.多媒体通信技术[M].北京:北京航空航天大学出版社, 2004: 266-267,271-272
[21] HalSall Fred.多媒体通信[M].北京:人民邮电出版社, 2004: 576-579
[22]孙宇.基于IPV6组播技术的VOD系统设计与实现[D].北京:北京邮电大学, 2008
[23]钟玉琢,向哲,沈洪.流媒体和视频服务器[M].北京:清华大学出版社, 2003:54-55
[24]戴俊.嵌入式实时流媒体服务器的实现.广州:华南理工大学, 2010
[25] Lu Qiming. DirectShow- a technical introduction[EB/OL]. http://www.programsalon.com/downloads74/ebook/detail264507.html,2007-4
[26]张睿萍.基于DirectShow的数字视频监控系统的研究与实现[D].武汉:武汉理工大学, 2008
[27]周彪.网络视频监控系统的研究和开发[D].吉林:吉林大学, 2007.
[28] DirectShow[EB/OL]. http://msdn.microsoft.com/en-us/library/ms783323(VS.85).aspx
[29] What is Gstreamer[EB/OL]. http://gstreamer.freedesktop.org/features/index.html
[30] Taymans W, Baker S, Wingo A. Gstreamer Application Development Manual[M/OL]. http://gstreamer.freedesktop.org/data/doc/gstreamer/head/manual/html/index.html
[31] Katafiasz M. Multipurpose Multimedia processing with Gstreamer. http://www.ibm.com/developerworks/aix/library/au-gstreamer.html?S_TACT=105AGX52&S_CMP=cn-a-aix, 2006-7
[32] part-overview[EB/OL]. http://dev.laptop.org/~mstone/sources/expanded_srpms/gstreamer-0.10.12-1.olpc2/gstreamer-0.10.12/docs/design/part-overview.txt
[33]肖文鹏.用Gstreamer简化Linux多媒体开发[EB/OL]. http://www.ibm.com/developerworks/cn/linux/l-gstreamer/index.html, 2004
[34] Boulton R.J, Walthinsen E, Baker S. Gstreamer Plugin Writer’s Guide[M/OL]. http://gstreamer.freedesktop.org/data/doc/gstreamer/head/pwg/html/index.html
[35]一步一步创建Gstreamer插件[EB/OL]. http://www.cnblogs.com/newgreen/archive/2010/12/14/1905246.html
[36] OMAP3530/25 Applications Processor[EB/OL]. http://www.ti.com/cn/lit/gpn/omap3530
[37]深圳市天漠科技有限公司. DEVKIT8000评估套件[EB/OL]. http://www.timll.com/chinese/uploadFile/TIOP/DevKit8000_Overview_CN.pdf
[38] Bhattacharya Rishi. DSP video processing via open-sourceAPIs[EB/OL]. http://www.eetimes.com/design/signal-processing-dsp/4004620/DSP-video-processing-via-open-sourceAPIs, 2006-10
[39] Davinci技术[EB/OL]. http://focus.ti.com.cn/cn/general/docs/gencontent.tsp?contentId=24809&DCMP=TI-cn_Hm_Brand_Tracking&HQS=v%83+OT+home_bc_davinci
[40]张起贵,张胜,张刚.最新DSP技术——“达芬奇”系统、框架和组件[M].北京:国防工业出版社, 2009: 143-170
[41] Codec Engine[EB/OL]. http://processors.wiki.ti.com/index.php/Codec_Engine
[42] Codec Engine Roles[EB/OL]. http://processors.wiki.ti.com/index.php/Codec_Engine_Roles
[43] TI Gstreamer DMAI Plug-In for DaVinci and OMAP Processors[EB/OL]. http://focus.ti.com/docs/toolsw/folders/print/gstreamer.html
[44] Gstreamer Plug-ins for TI hardware[EB/OL]. http://processors.wiki.ti.com/index.php/GStreamer
[45] Gstreamer on TI Davinci and OMAP[EB/OL]. https://gstreamer.ti.com/gf/project/gstreamer_ti/
[46] DVEVM and DVSDK overview[EB/OL]. http://processors.wiki.ti.com/index.php/DVEVM_and_DVSDK_overview
[47] ranlink RT2870[EB/OL]. http://www.ralinktech.com/product.php?s=23