基于用户感知质量优化的流媒体服务系统的研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
随着计算机技术、压缩技术以及通信技术的发展,流媒体业务得到了飞速的发展和应用。而Internet的无连接包转发机制主要是为突发性的数据传输而设计的,并不适用于对连续媒体流的传输。为了在Internet上有效的、高质量的传输流媒体,还需要多种技术的支持,例如流媒体编解码技术、传输控制技术、容错技术、同步技术和相关协议等。
     传统的网络应用通常以网络QoS(Quality of Service)参数来描述相应的服务质量,并不能完全适用于流媒体应用系统。从流媒体服务系统的角度来说,流媒体服务的最终目的是提供给用户满意的感知质量(QoE,Quality of Exeperience),QoE能够比较准确的反映终端用户端对流媒体服务的满意程度,例如图像是否清晰流畅、声音是否连续等。因此针对用户感知质量的优化来进行流媒体传输服务控制是研究的方向。
     研究内容包括以下几个方面:
     介绍了流媒体服务质量控制的相关理论和技术,提出了一个基于用户感知质量优化的流媒体服务系统框架。该服务框架中最重要的部分是QoE服务质量控制模块,包括QoE决策、QoE质量映射和服务区分三个子模块。QoE决策是针对流媒体应用定义其QoE指标参数,针对视频流应用,通常使用图像失真作为其QoE指标参数。QoE质量映射是指将当网络服务参数映射为QoE指标参数,将用户的QoE需求转化成对传输QoS服务的需求,可以协助流服务系统对QoE质量进定量的分析。区分服务则是根据媒体流数据包对QoE影响的不同对数据进行了分层处理,在传输系统中提供不同质量的服务。结合网络反馈参数和QoE服务质量模块的分析结果,框架中的自适应拥塞控制模块和自适应错误控制模块采取相应的优化控制策略,对传输服务进行有针对性的调整。该服务系统框架的特点是结合QoE质量分析进行传输策略优化控制,实现了高质量、高效率的流媒体传输服务。
     研究并实现了一个通用的视频QoE质量映射模型。研究了视频数据包丢失导致的图像失真和由于帧间解码依赖关系导致的错误扩散失真,结合视频错误隐藏技术进行建模分析,实现了一个通用的视频流QoE映射模型,也叫做传输失真模型。该模型在编解码算法和错误隐蔽算法确定的情况下,在发送端通过网络Qos参数和视频编码参数估算视频流媒体的QoE质量损失,能够为同步控制、传输控制等算法提供定量的参考指标。QoE质量映射模型实现了QoS参数到QoE的模糊映射,能够为视频流应用提供比较准确的定量分析依据。
     研究了视频流媒体拥塞控制机制,提出并实现了基于QoE优化的自适应拥塞控制算法及改进算法。自适应拥塞控制算法根据编码宏块的重要性测定参数将数据包进行分层处理,在进行拥塞控制的时候,主动丢弃重要性较低的数据包,尽量保证高重要性的数据包优先传输,使得QoE质量最优。改进的拥塞控制算法则是使用前向扫描和后向扫描的预取数据传输机制,保证了QoE质量的平稳性。实验证明基于QoE优化的自适应拥塞控制算法及改进算法相比其它同类算法,恢复图像的平均PSNR有所提高。
     研究了视频流媒体传输错误控制机制,提出并实现了基于QoE优化的自适应FEC算法。算法根据传输层反馈参数计算冗余数据可用的最大带宽,根据编码宏块的重要性测定参数对打包数据提供了不同的服务策略。包括对可自然恢复的数据包不增加冗余数据,对不同重要性的编码宏块分配相应比例的冗余数据,根据编码宏块重要性进行打包策略优化。实验证明了基于QoE优化的自适应FEC算法在保证终端QoE质量的同时,能够减少网络开销。在同等网络条件下,相比其它同类算法能够提高视频QoE质量,恢复图像的平均PSNR值提高了0.1-2dB。
Along with deeply development of computer technology, compression technology and communications technology, the Streaming Media Business became fast developed and widespread used。But currently there are a lot of difficulties to transfer Streaming Media by Internet; the main reason is that the Internet was not designed for continuously connectionism Streaming Media transfer, but only for paroxysmal data transfer. For the purpose to efficiently transfer Streaming Media with high quality, there are many kinds of technology supports are needed, such as Streaming Media coding technique, QOS technique, fault-tolerant technique, simultaneous techniques and relevant agreements etc.
     Raditional network applications usually use net QOS parameter to describe the corresponding service quality, but cannot absolutely apply to Streaming Media Application System. In terms of Streaming Media service system, the final purpose of it is to provide sensible quality QOE for customers' satisfaction, sensible quality QOE can be much more precisely mirror the end-user satisfaction about Streaming Media service, such as if the image clear and fluently transfer, or the voice continuously transfer etc. Therefore direction of research is to achieve the Streaming Media service system control with end-user sensible quality QOE.
     The contents of research as follows:
     This article particularly presents the theory and technology of Streaming Media service quality control system, advances a theory of Streaming Media service system frame based on QOE sensible quality optimization. Which is the most important improvement from that frame is to join QOS network service parameter into QOE sensible service quality mapping module and Streaming Media distinguish module, service quality mapping module will make the user's QOE needs into the service needs of network's QOS, provide assistance to system on the quantitative analysis of QOE. Differentiated Services Module can offer the differentiated service on Media internal data according to the importance of Streaming Media contents, the differentiated service can also assist system to have a pointed revision on service part by cache memory scheduling, adaptive transmission, error control those streaming media control mechanism. As a primary objective the frame improves the quality of user's QOE perceived, and a wide range of practical value.
     After research, found the realization of a model which points against of QOS parameter to QOE sensible quality mapping model by the video Streaming Media transmission, also known as the transmission distortion model. Studied the common technology based on macro video streaming media codec technology, analysis of the video frame codec between the dependence caused by the proliferation of video streaming error distortion, the final combination of video streaming technology for a unified error analysis of hiding, to achieve the predictive coding based on video streaming media transmission distortion model. The model is able to codec algorithms and error concealment algorithm to determine the circumstances in the sending end through the network QOS parameters and parameter estimation video coding video streaming media QOE mass loss, can simultaneously control and transmission control algorithms and other quantitative indicators. QOS parameters of network services to QOE mapping perceived quality streaming media service module is the most important service module, as well as the video streaming services is the most complex and commonly used services. This research based on predictive coding of video streaming media transmission distortion model parameters to achieve the QOS service to the QOE perceived quality of the fuzzy mapping, to provide similar quantitative analysis for the current vast majority network of video streaming media applications.
     Research on the video streaming media congestion control mechanism, designed and implemented to optimize the QOE-based adaptive congestion control algorithm and improved algorithm. Algorithm based on quantitative analysis of video streaming media transmission from the QOS parameters to QOE perceived quality mapping , differentiated services based on macro block coding QOE perceived quality of the contribution. Algorithm based on the importance of hierarchical data processing parameters, in a time when deal with congestion control, as far as possible to ensure the best quality of QOE end. Experiments show that the control algorithm can effectively improve the performance of streaming media transmission and the image quality of the client, and it can also be effectively enhanced the QOE quality of video streaming.
     Research on the video streaming media transmission error control mechanism, a new algorithm was designed and implemented to optimize the QOE-based adaptive FEC algorithm. Algorithm based on quantitative analysis of video streaming media transmission from the QOS parameters to QOE perceived quality mapping , differentiated services based on macro block coding QOE perceived quality of the contribution. Mainly including the corresponding proportion of redundant data by the importance of coding for different macro block allocation, in accordance with the importance of encoding macro blocks to pack up the optimization strategy. Experiments show that the control algorithm can effectively improve the performance of streaming media transmission and the image quality of the client, and it can also be effectively enhanced the QOE quality of video streaming.
引文
[1]张丽.流媒体技术大全.第一版.北京:中国青年出版社,2001.8:2-10
    [2]刁兆坤.移动流媒体技术与典型应用.中国多媒体视讯,2005,10:55-56
    [3]李相周.移动流媒体技术及其在3G移动通信中的应用.通信世界,2006,5:46-47
    [4]吴国勇,丘学钢,万燕仔.网络视频—流媒体技术与应用.北京:北京邮电大学出版社,2002:109-153
    [5]徐京,鲁士文.TCP/IP网络环境下的视频图像传输.第一版.计算机工程与应用,1999,2(12):33-54
    [6]苏群,冲瑞民,张同珍等.远程教育中流媒体的同步标准设计及其智能型点播系统的实现.计算机工程,2002,3(10):280-282
    [7]钟玉琢,王琪,贺玉文.基于对象的多媒体数据压缩编码国际标准MPEG-4及其校验模型.计算机工程,2000,5(10)
    [8]石乐,荆雷.MPEG-4的主要技术概览.计算机与通信,2004,11(4):35-37
    [9]IETF RFC2209.Resource reservation Protocol(RSVP)vl 1997
    [10]IETF RFC2475.An architecture for differentiated serviees 1998
    [11]戴中华.流媒体服务器中端到端服务质量的研究:[硕士学位论文].南京:南京邮电学院,2005
    [12]章民融,徐亚锋.基于RTSP的流媒体视频服务器的设计与实现.计算机应用与软件,2006,23(7):93-94
    [13]周敬利,张超,余胜生等.一种基于RTP的多媒体业务质量控制算法.华中科技大学学报(自然科学版),2002,30(9):18-19
    [14]Reza Rejaie,Amy Reibman.Design Issues for Layered Quality2 adaptive Internet Video Playback.Proceedings of the International Workshop on Digital Communications,Taormina,Italy.2001.15-17
    [15]Braden B,Zhang L.Resource Reservation protocol(RSVP)-version 1 message process in grules.IETF,1997,4(3)
    [16]J.Rosenberg,Symposium on Communications Architectures and Protocols.IEEE,1998,4(5):303-314.
    [17]Gregory J.Conklin,Gray S.Greenbaum,Karl O.Lillevold."Video Coding for Streaming Media Delivery on the Internet".IEEE,2001,5(6):12-14
    [18]Gary J.Sullivan,Thomas Wiegand.Rate-Distortion Optimization for Video Compression.IEEE Signal Processing Magazine,1998,15(6):74-90
    [19]S.W.Wu and A.Gersho.Rate-constrained optimal block-adaptive coding for digital tape recording of HDTV.IEEE Trans.on Circuits and Sys.For Video Tech.,1991,1(1):100-112
    [20]Jacobson.Congestion Avoidance and Control.SIGCOMM Symposium on Communications Architectures and Protocols.IEEE,1988,5:314-329
    [21]Gregory J.Conklin,Gray S.Greenbaum.Symposium on Communications Architectures and Protocols.IEEE,1998,8(8):303-314.
    [22]Floyd S.Connections with Multiple Congested Gateways in Packet-Switched Networks,Part 1:One-way Traffic.ACM Computer Communication Review,1991,21(5):30-47
    [23]Floyd S,Jacobson V.Random Early Detection Gateways for Congestion Avoidance.IEEE/ACM Trans-actions Networking,1993,1(4):397-413
    [24]RFC2581:TCP Congestion Control:15-36
    [25]Mahdavi J,Floyd S.TCP-Friendly Unicast Rate-based Flow Control.IEEE/ACM Trans-actions Networking,1992,13(1):22-31
    [26]ISO/IEC 13818-2:Information technology-Generic coding of moving pictures and associated audio information:Video(MPEG-2),1995
    [27]吴枫,李世鹏,张亚勤.渐进、精细的可伸缩性视频编码.计算机学报,2000,23(12):1276-1282
    [28]原岛博.图像信息压缩.第一版.北京:科学出版社,2004:12-14
    [29]ISO/IEC JTC1,Call for Proposals on Scalable Video Coding Technology,ISO/IEC JTC1/WG11 Doe.N5958,Oct.2003
    [30]ISO/IEC JTC1,Requirements and Applications for Scalable Video Coding,ISO/IEC JTC1/WG11 Doc.N6025,Oct.2003
    [31]Torres L.,Delp E.,New trends in image and video compression,EUSIPCO 2000,Tampere,Finland,September 4-8,2000
    [32]AVS Video Expert Group,Information Technology- Advanced Audio Video Coding Standard Part 2:Video,in Audio Video Coding Standard Group of China (AVS),Doe.AVS-N 1063,Dec.2003
    [33]B.G.Haskell,A.Puri,A.N.Netravali.Digital Video:An Introduction to MPEG-2.New York:Chapman & Hall,Sept.1996
    [34]Zhai Mingyu,Gu Guanqun,Yuan Yuan.Fair bandwidth allocations through queue management in core-stateless networks.IEEE,2001,3(4):2248-2252.
    [35]罗万明,林闯,阎保平.一种支持多媒体通信QoS的拥塞控制机制.电子学报,2000,11:48-52
    [36]刘郁恒.Internet中TCP-Friendly拥塞控制策略的研究:[博士学位论文].广州:中山大学,2003
    [37]胡严,因特网中多媒体流传输的拥塞控制协议研究,[博士学位论文].广州:中山大学,2002
    [38]吴翔,奉余莽.IP网络中提供QoS支持的方案综述.计算机应用研究,2000,4
    [39]Mahdavi J,Floyd S.TCP-Friendly Unicast Rate-based Flow Control.IEEE,1992,4(01):132-133
    [40]Floyd S,Fall K.Promoting the Use of End-to-end Congestion Control in the Internet.IEEE/ACM Transactions on Networking,1999.7(4):458-472.
    [41]Jin S D,Guo L,Matta I,Bestavros.TCP-friendly SIMD Congestion Control and Its Convergence Behavior.IEEE/ACM Transactions on Networking,2001:156-164.
    [42]刘郁恒.Internet中TCP-Friendly拥塞控制策略的研究:[博士学位论文].广州:中山大学,2003
    [43]胡严,因特网中多媒体流传输的拥塞控制协议研究,[博士学位论文].广州:中山大学,2002
    [44]Shirish S.Karande,Hayder Radha.Rate-Constrained Adaptive FEC for Video over Erasure Channels with Memory,Signal Processing:Image Communication,2003,8:101-114
    [45]R.Aravind,M.R.Civanlar,A.R.Reibman.Packet loss resilience of MPEG-2 scalable video coding algorithm.IEEE Trans.Circuits Syst.Video Technology,1996,6(10):426-435
    [46]周敬利,程勇刚,余胜生.一种基于统计的H.264差错信道下抗误码方法.计算机工程与科学,2005,27(7):65-70
    [47]甘亚莉,钟文丽.视频通信中的错误隐藏技术.计算机应用研究,2003,2(3):8-9
    [48]曾宇永,喻飞.视频通信中失真掩蔽.《中国有线电视》,2004,3(14):15-18
    [49]Yao Wang,QinFan Zhu.Error control and concealment for video communication a review.Proceedings of the IEEE,1998,86(5):974-997
    [50]ITU-T.Video coding for low bit rate communications.ITU-T Recommendation H.263,1998
    [51]J.Zamora,S.Jacobs,A.Eleftheriadis,et al.A practical methodology for guaranteeing quality of service for video-on-demand.IEEE Transactions on Circuits and Systems for Video Technology,2000,10(2):168-178
    [52]T.Sikora.The MPEG-4 video standard verification model.IEEE Trans.On Circuits and Systems for Video Technology,1997,7(2):19-31
    [53]T Wiegand,G.J Sullivan,G Bjntegaard,et al.Overview of the H.264/AVC Video Coding Standard.IEEE Transaction on Circuits and Systems for Video Technology,2003 13(7):560-576
    [54]数字音视频标准化工作组,http://www.avs.org.cn
    [55]J Hayes.Adaptive feedback communications.IEEE Transactions on Communications,1968,16(1):29-34
    [56]J Cavers.Variable-rate transmission for Rayleigh fading channels.IEEE Transactions on Communications,1972,20(1):15-22
    [57]Y.Kamio,S.Sampei,H.Sasaoka,et al.Performance of modulation-level-controlled adaptive-modulation under limited transmission delay time for land mobile communications.VTC'95,1995.221-225.
    [58]B.Vucetic.An adaptive coding scheme for time-varying channels.IEEE Transactions on Communications,1991,39(5):653-663
    [59]D.Hughes-Hartogs,Emsemble modern structure for imperfect transmission media, U.S. patents Nos. 4,679,227(July 1987), 4,731,816(March 1988) and 4,833,706(May 1989)
    [60] ]Liu Q. ,Zhou S. ,Giannakis. Cross-Layer combining of adaptive modulation and coding with truncated ARQ over wireless links. IEEE Transactions on Wireless Communications, 2004, 3(5): 1746-1755
    [61] Zhihai He, Jianfei Cai, Chang Wen Chen. Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding. IEEE Transactions on CSVT, 2002,12(6):511-523
    [62] K.Stuhlmuller, N.Farber, M.Link, B.Girod. Analysis of video transmission over lossy channels. IEEE Journal on Selected Areas in Communications, 2000, 18(6):1012-1032
    [63] van der Schaar, M.K, Adaptive cross-layer protection strategies for robust scalable video transmission over 802.11 WLANs. IEEE Journal on Selected Areas in Communications, 2003,21 (10): 1752-1763
    [64] Zhang Qian , Zhu Wenwu , Zhang Yaqin. End-to-End QoS for Video Delivery Over Wireless Internet. Proceedings of IEEE. 93(1) , January 2005 , 123-134.
    [65] W.Kumwilaisak , Y.Hou , Q.Zhang , ete. Across-layer quality of service mapping architecture for video delivery in wireless networks. IEEE Journal on Select Areas Communications. December, 2003, 1685-1698.
    [66] Orteg. Ramchandran Rate-distortion methods for image and video compression. IEEE Signal Proeessing Magazine, November, 2001, 23-50
    [67] M.Handley , S.Floyd , J.Padhye , ete. TCP-Friendly rate control (TFRC): Protocol specification Request for Comments , IETF , RFC 3448 , 2003.
    
    [68] 任丰源,林闯,刘卫东. ip 网络中的拥塞控制.计算机学报,2003, 26(9),1025-1034.
    [69] Minoru Etoh and Tankeshi Yoshimura. Advances in wireless video delivery. Proceeding of the IEEE, 93(1), 2005, 121-122.
    [70] Nahrstedt K, Chen K. Limitations of equation-based congestion control in mobile Ad hoc networks. Proceeding of the ICDCS Workshops'2004, Tokyo, Japan,IEEE, 2004, 756-761.
    [71]Zhang Zhanjun.Guaranteeing End-to-End adaptive QoS in wireless multimedia networks.Chinese Journal of Computers,27(8),2004,1064-1073.
    [72]Chen Minghua,Zakho r.Rate control for streaming video over wireless.IEEE Wireless Commumcations,12(4),Angust 2005,1181-1190.
    [73]Song Cen,Cosman P C,Voelker GM.End-to-end differentiation of congestion and wireless losses.IEEE/ACM Transactions on Networking,11(5),October 2003,703-717.
    [74]Ozgur B.A kan,Ian F A kyildiz.ARC:The analytical rate control scheme for real-time traffic in wireless networks.IEEE/ACM Transactions on Networking,12(4),August2004,634-644.
    [75]Tang J,Morabito G,Akyildiz I F,et al.RCS:a rate control scheme for real-time traffic in networks with high bandwidth-delay products and high bit error rates.In:ProceedingofINFOCOM'2001,IEEE,2001,114-122.
    [76]S.Floyd and K.Fall Promoting the Use of End-to-End Congestion control in the Intemet.IEEE/ACM Transactions on Networking.7(4),August1999,458-472.
    [77]]朱晓亮,杜旭,杨宗凯.一种适用于流媒体传输的无线TCP友好速率控制机制.小型微型计算机系统,28(4)2007.4,578-582
    [78]I.F.Akyildiz,G.Morabito,and S.Palazzo.TCP-Peach:A New Congestion Control Scheme for Satellite IP Networks,IEEE/ACM Transaction on Networking,9(3),June 2001,307-321.
    [79]H.Sehulzrinne,S.Casner,R.Frederiek,ete.RTP:A transport for real-time applications.Network Working Group,RFC1889,Jan,1996.
    [80]R Rejiaie,M Handle,D Estrin.RAP:An End-to-End Rate-based Congestion Control Mechanism for Real-time Streams in the Intemet.In:Proceedings of INFOCOMM'99,1999,1337-1345.
    [81]D Wu,Y THou,W Zhu,et.On end-to-end architecture for transporting MPEG-4video over the Internet.IEEE Transactions on Curcuits system video technology,10(6),September2000,923-941.
    [82]Wu DaPeng,Robit Negi.Effective capacity:A wireless link model for support of quality of service.IEEE Transactions on Wireless Communications,2(4),July 2003,630-643.
    [83]W.Kumwilaisak,Y.Hou,Q.Zhang,ete.A cross-layer quality of service mapping architecture for video delivery in wireless networks.IEEE Journal on Select Areas Communications,21(10),December2003,1685-1698.
    [84]Lajos Hanzo,Peter J.Cherriman,and Juergen Streit.Wireless Video Communications.Digital & Mobile Communications.IEEE Press,445 Hoes Lane,Piscataway,2001.
    [85]Martyn J,Riley and E.G.Richardson.Digital Video Communications.Artech House,685 Canton Street,Norwood,1997.
    [86]The Network Simulator.URL:http://www.sis.edu/nsnam/ns
    [87]Feamster N,Balakrishnan H.Packet loss recovery for streaming video.In:Proc of the 12~(th) intl Packet Video Workshop.2002.
    [88]G.Carle and E.Biersack.Survey of error recovery techniques for IP-based audio-visual multicast applications,IEEE Network,11(6),December1997,24-36.
    [89]Xiao Su and Benjamin W.Wah,Multi-description video streaming with optimized reconstruction-based DCT and neural-network compensations.IEEE Transactions on Multimedia,3(3),2003,123-131.
    [90]B.W.Wah,X.Su,and D.Lin.A survey of error-concealment schemes for real-time audio and video transmissions over the Intemet.In:Proceedings of International Symposium on Multimedia Software Engineering,IEEE,Taiwan,2000,17-24
    [91]Johanson M.Adaptive forward error correction for real-time internet video.In:Proc of the13th Packet Video Workshop.2003.http://www.polytech.univ-nantes.fr/pv2OO3/papers/pv/papers/cr1001.pdf
    [92]梅峥,李锦涛.一种自适应的视频流化前向纠错算法.软件学报,2004,15(9).
    [93]Chen-Han Lin,Chih-Heng Ke,Ce-Kuen Shieh.An Enhanced Adaptive FEC Mechanism for Video Delivery over Wireless Networks,In:Proceedings of International Conference on Networking and Services(ICNS,06).Silicon Valley USA,2006,16-18.
    [94]Chih-Heng Ke,Naveen Chilamkurti,Gaurav Dudeja,Ce-Kuen Shieh.A New Adaptive FEC Algorithm for Wireless LAN Networks.In Proceedings of The IASTED International Conference on Networks and Communication Systems,March,2006,ChiangMai,Thailand.
    [95]Hartanto F,Sirisena HR.Hybrid error control mechanism for video transmission in the wireless networks.In:Proc of the 10~(th) IEEE Workshop on Local and Metropolitan Area Networks(LANMAN).1999.
    [96]周树民,李锦涛,张勇东.易错视频传输中基于带宽.失真代价最小化准则的部分重传代码.计算机学报,2007,30(2)
    [97]R.E.Blahut,Theory and practice of error-control codes Addison-Wesley,Reading,MA,1983.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700