基于RTSP协议的流媒体自适应系统的设计与实现
|
摘要
随着近年来3G\wifi无线网络普及率的提高，各种移动终端不断涌现，包括各种基于android的智能手机、基于苹果IOS的iphone/ipad/itouch、基于windows phone操作系统的智能手机以及基于linux系统的各种国产平板电脑，在这些智能操作系统上的流媒体应用也成为各大厂商竞争的对象。其中尤其以苹果的http adaptive streaming,微软的smooth streaming以及adobe公司的rtmp streaming自适应流媒体技术引人注目，它们都能在无线环境下，使客户端实时监测当前网络变化情况，并通知服务器端随时调整发送媒体质量的技术。有鉴于此，本文通过研究上述三家公司的自适应技术，并结合上海电信的魔屏项目，提出了一种基于RTSP协议的流媒体自适应技术，并在魔屏终端上得到实现。
本文的主要工作如下：
(1)分析了目前主流自适应流媒体技术的设计思想。
(2)采用TS（transport stream）文件作为自适应流媒体文件，并通过对TS文件的研究，给出了TS文件的实时码流算法、关键帧提取算法以及基于FFmpeg开源软件的TS文件逻辑切片算法。
(3)采用RTSP协议作为自适应流媒体系统的自适应协议，并通过对RTSP协议的分析，比较了ISMA RTSP和本文的基于TS的RTSP协议的异同，在此基础上扩展了RTSP协议，使其能够配合TS文件的逻辑切片，在不同的TS码流文件中进行切换，为客户端提供不同质量的TS文件。
(4)采用DSS（Darwin Streaming server达尔文流媒体服务器）作为自适应系统的服务器端软件，并通过对DSS这一开源流媒体服务器软件的研究分析，对其进行了相关的二次开发，使其能够支持基于TS文件的RTSP协议及其扩展协议。
(5)在客户端切换算法中，提出了一种针对移动流媒体的实时抖动算法，该算法能够对目前无线网络的乱序状态进行计算，并通过rtcp协议实时发送给服务器端，使服务器端判断是否需要切换到高码流TS文件或是低码流TS文件。
As these years with the increasing popularity of3G and wifi network,many kinds ofmobile terminals come into people’s eyes.Including many kind of smart terminals such asmobile phones based on the android system,iphone\ipad\itouch based on apple’s IOS,smartphones based on the windows phone operating system and many kinds of tablet PC based onthe linux operating system.The streaming media becomes the intense competiton around thesethree IT companies.Among these media streaming technologies,the apple’s http adaptivestreaming,the microsoft’s smooth streaming and the adobe’s rtmp streaming become thefocus of people’s eyes.
These three adaptive streaming technology can all make the mobile terminals monitor thestatus of network in real time,and the terminals can notify the streaming server to adjust thequality of media streaming.Thus upgrade the feelings of people’s experience.In view ofthis,the paper research these three companys’ adaptive streaming technology and combine theproject of magic screen project on shanghai’s telecom,raise one adaptive technology based onthe rtsp protocols,and achieve the purpose of adaptive media streaming on the magic screenterminal.
The work on the paper as follows:
1. Analysize the design of today’s most popular adaptive streaming.
2. By the research of TS file, we give the algorithm of the TS file’s real bit rate,thealgorithm of key frame of ts file and the algorithm of TS file’s logic segmentation.
3. By the research of rtsp protocol,we compare the isma rtsp and the rtsp based on thempeg2-ts.On the basis,we expand the rtsp protocol,make it coordinate the ts file’slogic segment,and switch among the multibate ts files,so the rtsp file can support the ts file with multiple quality.
4. With the research of Darwin streaming server(DSS),we redevelop the open source ofDSS,make it support the expanding rtsp protocol based on the mpeg2-ts.
5. Among the client’s switching algorithm,we give the shaking algorithm against themobile media streaming.The algorithm can calculate the out of order state of the realtime wireless network.And make the use of rtcp protocol to notify the streamingserver.So the streaming server can make the judgment of switching to high quality tsfile or the low quality one.
本文的主要工作如下：
(1)分析了目前主流自适应流媒体技术的设计思想。
(2)采用TS（transport stream）文件作为自适应流媒体文件，并通过对TS文件的研究，给出了TS文件的实时码流算法、关键帧提取算法以及基于FFmpeg开源软件的TS文件逻辑切片算法。
(3)采用RTSP协议作为自适应流媒体系统的自适应协议，并通过对RTSP协议的分析，比较了ISMA RTSP和本文的基于TS的RTSP协议的异同，在此基础上扩展了RTSP协议，使其能够配合TS文件的逻辑切片，在不同的TS码流文件中进行切换，为客户端提供不同质量的TS文件。
(4)采用DSS（Darwin Streaming server达尔文流媒体服务器）作为自适应系统的服务器端软件，并通过对DSS这一开源流媒体服务器软件的研究分析，对其进行了相关的二次开发，使其能够支持基于TS文件的RTSP协议及其扩展协议。
(5)在客户端切换算法中，提出了一种针对移动流媒体的实时抖动算法，该算法能够对目前无线网络的乱序状态进行计算，并通过rtcp协议实时发送给服务器端，使服务器端判断是否需要切换到高码流TS文件或是低码流TS文件。
As these years with the increasing popularity of3G and wifi network,many kinds ofmobile terminals come into people’s eyes.Including many kind of smart terminals such asmobile phones based on the android system,iphone\ipad\itouch based on apple’s IOS,smartphones based on the windows phone operating system and many kinds of tablet PC based onthe linux operating system.The streaming media becomes the intense competiton around thesethree IT companies.Among these media streaming technologies,the apple’s http adaptivestreaming,the microsoft’s smooth streaming and the adobe’s rtmp streaming become thefocus of people’s eyes.
These three adaptive streaming technology can all make the mobile terminals monitor thestatus of network in real time,and the terminals can notify the streaming server to adjust thequality of media streaming.Thus upgrade the feelings of people’s experience.In view ofthis,the paper research these three companys’ adaptive streaming technology and combine theproject of magic screen project on shanghai’s telecom,raise one adaptive technology based onthe rtsp protocols,and achieve the purpose of adaptive media streaming on the magic screenterminal.
The work on the paper as follows:
1. Analysize the design of today’s most popular adaptive streaming.
2. By the research of TS file, we give the algorithm of the TS file’s real bit rate,thealgorithm of key frame of ts file and the algorithm of TS file’s logic segmentation.
3. By the research of rtsp protocol,we compare the isma rtsp and the rtsp based on thempeg2-ts.On the basis,we expand the rtsp protocol,make it coordinate the ts file’slogic segment,and switch among the multibate ts files,so the rtsp file can support the ts file with multiple quality.
4. With the research of Darwin streaming server(DSS),we redevelop the open source ofDSS,make it support the expanding rtsp protocol based on the mpeg2-ts.
5. Among the client’s switching algorithm,we give the shaking algorithm against themobile media streaming.The algorithm can calculate the out of order state of the realtime wireless network.And make the use of rtcp protocol to notify the streamingserver.So the streaming server can make the judgment of switching to high quality tsfile or the low quality one.
引文
[1]. Dmnelson,Getting started with IIS live smooth streaming[J/OL],http://learn.iis.net/page.aspx/620/getting－started－with－iis－live－smooth－streaming,2011
[2].HaakonRiiser, P lHalvorsen, CarstenGriwodz, DagJohansen, Low Overhead ContainerFormat for Adaptive Streaming, MMSys '10Proceedings of the first annual ACMSIGMM conference on Multimedia systems [R],2010,193-198
[3].Alex Zambelli,IIS Smooth Streaming Technical Overview,Microsoft Corporation[Z],2009,9~10
[4].《RTMP Specification1.0》[J/OL], http://www.adobe.com/devnet/rtmp.html
[5].《Dynamic streaming in Flash Media Server3.5–part1: Overview of the newcapabilities》[J/OL],http://www.adobe.com/devnet/flashmediaserver/articles/dynstream_advanced_pt1.html
[6].《Dynamic stream switching with Flash Media Server3》[J/OL]http://www.adobe.com/devnet/flashmediaserver/articles/dynamic_stream_switching.html
[7].《HTTP Live Streaming Overview》[J/OL]http://developer.apple.com/library/ios/#documentation/networkinginternet/conceptual/streamingmediaguide/Introduction/Introduction.html
[8].霍龙社，甘震，移动流媒体协议综述[J],业务与运营，2010，第4期
[9].高玉金,石峰,张艳苏，MPEG-4分层视频的自适应传输构架[J]，计算机应用，2003，第12期，3-6
[10].邹勇，赵海，赵明，宋纯贺，基于MVC的实时流媒体自适应跟踪传输算法[J]，东北大学学报，2010，第11期
[11].严峻，流媒体自适应播放技术的研究[D]，清华大学，自动化系，2007，34-35
[12].虞俊杰，面向移动流媒体的动态多码率转码技术研究[D]，浙江大学，计算机软件与理论，2007，13-14
[13].汪大勇，孙世新，可伸缩视频编码研究现状综述[J]，电子测量与仪器学报，2009，第23卷，第8期
[14].ISO/IEC13818-1:2000Information technology-generic coding of moving pictures andassociated audio information[S].Systems,2000,31-34
[15].田建柏，数字电视传输流PCR抖动分析及MPEG II解码器仿真测试[R]，罗德与施瓦茨中国有限公司，2007，2-3
[16].FFMpeg技术，FFMpeg的详细说明[Z],http://www.ffmpeg.com.cn/index.php/%E9%A6%96%E9%A1%B5
[17].Schulzrinne, H. Rao, A. and R. Lanphier,"Real Time Streaming Protocol (RTSP)", RFC2326[S], April1998
[18].Schulzrinne H.Casner S.Frederick R.etal.RTP:A transport protocol for real-timeapplications,RFC3550[S],July2003,34-52
[19].Handley M.Jacobson V.SDP:Session description protocol,RFC2327[S],April1998,3-5
[20].ISMA2.0:Internet Streaming Media Alliance Implementation Specification, Version2.0,April2005,9-10
[21].廖伟全，基于媒体感知ARQ的无线视频流QOS保障研究[D]，南京邮电大学，2011，33-35
[22].QuickTime Streaming Server Modules Programming Guide[J/OL],http://developer.apple.com/legacy/mac/library/documentation/QuickTime/QTSS/QTSS.pdf,2005,16
[23].黄拔峰，钟明，杨传钧，张家钰，东华大学，Darwin streaming server的研究与应用[J]，计算机工程，2004，第30卷，第19期
[24].陈森，王厚信，王雯玉，TS over IP视频传输质量监测方法探讨[J],广播与电视技术，2011，第三期
[25].J.Welch,J.Clark IneoQuest Technologies, Cisco Systems A Proposed Media DeliveryIndex (MDI), RFC4445[S], April2006,3-6
[2].HaakonRiiser, P lHalvorsen, CarstenGriwodz, DagJohansen, Low Overhead ContainerFormat for Adaptive Streaming, MMSys '10Proceedings of the first annual ACMSIGMM conference on Multimedia systems [R],2010,193-198
[3].Alex Zambelli,IIS Smooth Streaming Technical Overview,Microsoft Corporation[Z],2009,9~10
[4].《RTMP Specification1.0》[J/OL], http://www.adobe.com/devnet/rtmp.html
[5].《Dynamic streaming in Flash Media Server3.5–part1: Overview of the newcapabilities》[J/OL],http://www.adobe.com/devnet/flashmediaserver/articles/dynstream_advanced_pt1.html
[6].《Dynamic stream switching with Flash Media Server3》[J/OL]http://www.adobe.com/devnet/flashmediaserver/articles/dynamic_stream_switching.html
[7].《HTTP Live Streaming Overview》[J/OL]http://developer.apple.com/library/ios/#documentation/networkinginternet/conceptual/streamingmediaguide/Introduction/Introduction.html
[8].霍龙社，甘震，移动流媒体协议综述[J],业务与运营，2010，第4期
[9].高玉金,石峰,张艳苏，MPEG-4分层视频的自适应传输构架[J]，计算机应用，2003，第12期，3-6
[10].邹勇，赵海，赵明，宋纯贺，基于MVC的实时流媒体自适应跟踪传输算法[J]，东北大学学报，2010，第11期
[11].严峻，流媒体自适应播放技术的研究[D]，清华大学，自动化系，2007，34-35
[12].虞俊杰，面向移动流媒体的动态多码率转码技术研究[D]，浙江大学，计算机软件与理论，2007，13-14
[13].汪大勇，孙世新，可伸缩视频编码研究现状综述[J]，电子测量与仪器学报，2009，第23卷，第8期
[14].ISO/IEC13818-1:2000Information technology-generic coding of moving pictures andassociated audio information[S].Systems,2000,31-34
[15].田建柏，数字电视传输流PCR抖动分析及MPEG II解码器仿真测试[R]，罗德与施瓦茨中国有限公司，2007，2-3
[16].FFMpeg技术，FFMpeg的详细说明[Z],http://www.ffmpeg.com.cn/index.php/%E9%A6%96%E9%A1%B5
[17].Schulzrinne, H. Rao, A. and R. Lanphier,"Real Time Streaming Protocol (RTSP)", RFC2326[S], April1998
[18].Schulzrinne H.Casner S.Frederick R.etal.RTP:A transport protocol for real-timeapplications,RFC3550[S],July2003,34-52
[19].Handley M.Jacobson V.SDP:Session description protocol,RFC2327[S],April1998,3-5
[20].ISMA2.0:Internet Streaming Media Alliance Implementation Specification, Version2.0,April2005,9-10
[21].廖伟全，基于媒体感知ARQ的无线视频流QOS保障研究[D]，南京邮电大学，2011，33-35
[22].QuickTime Streaming Server Modules Programming Guide[J/OL],http://developer.apple.com/legacy/mac/library/documentation/QuickTime/QTSS/QTSS.pdf,2005,16
[23].黄拔峰，钟明，杨传钧，张家钰，东华大学，Darwin streaming server的研究与应用[J]，计算机工程，2004，第30卷，第19期
[24].陈森，王厚信，王雯玉，TS over IP视频传输质量监测方法探讨[J],广播与电视技术，2011，第三期
[25].J.Welch,J.Clark IneoQuest Technologies, Cisco Systems A Proposed Media DeliveryIndex (MDI), RFC4445[S], April2006,3-6