基于H.264/AVC的无线视频通信系统关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
在过去十年中,无线通信和多媒体通信技术取得了飞速发展,并获得了巨大的商业成功。无线通信和多媒体技术的融合正在加速进行,在视频压缩算法、视频传输网络架构与协议、数字信号处理芯片等方面的研究成果不断涌现。面向无线通信的视频图像编解码与传输技术已成为当今信息技术领域的前沿课题之一。
     H.264/AVC是由国际标准化组织/国际电工委员会(ISO/IEC)中的运动图像专家组(MPEG)和国际电信联盟(ITU-T)中的视频编码专家组(VCEG)结合起来组成的联合视频工作组(JVT)制订的新一代国际视频编码标准,采用了近几年来视频编码方面的先进技术,以较高编码效率和网络友好性在各种视频服务中被广泛地应用。
     本文针对基于H.264的无线视频通信系统中的关键技术展开了深入细致地研究。具体包括:视频信源编码中的宏块模式选择快速算法、速率控制算法和容错编码方法;信道编码中的不均衡差错保护;和基于H.264的扩展空域可分层编码中增强层宏块的快速模式选择和细粒度可分层编码(FGS)中的抗漂移差错方法。致力于解决H.264编码器计算复杂度高而移动终端计算能力较弱的问题,H.264视频码流在易错的无线网络中鲁棒传输的相关问题,和如何在目前广泛存在的异构网络中开展H.264视频应用的问题。
     本文的主要内容和创新之处为:首先,介绍了基于H.264的无线视频通信系统,并对H.264码流中宏块/子宏块的编码模式和编码过程中的重要参数进行了统计分析,为后续提出的各种算法提供了依据。其次,分别提出了降低帧内(I)帧编码计算复杂度的帧内预测快速算法和降低预测(P)、双向预测(B)帧宏块模式选择计算复杂度的快速算法。再次,采用信源信道联合编码的思想,提出了一种把速率控制与容错编码和不均衡差错保护有机地结合起来的无线视频通信解决方案。最后,使用基本层局部宏块的运动和纹理特性,分别提出了降低拓展空域可分层(ESS)编码中增强层宏块模式选择的计算复杂度和对自适应参考帧FGS(AR-FGS)编码中采用的泄漏系数α进行局部自适应调整的方法。
In the past decade,a rapid development of wireless communication and multimedia communication techniques has been achieved,and it resulted in great commercial success.The merge of wireless communication and multimedia techniques is accelerating recently and productions emerge continuously such as video transmission network protocols,powerful digital video signal processing chips as well as efficient video compression algorithms.The research on the video codec and video stream transmission in wireless environment has become an active task in information science and technology field.
     H.264/AVC is the newest international video coding standard approved by the joint video team(JVT) organization which is formed by ITU-T VCEG(Video Coding Experts Group) and ISO/IEC MPEG (Moving Picture Experts Group).H.264 adopts a number of advanced video coding technologies and has been used in all sorts of video applications because of its high coding efficiency and network friendliness.
     This dissertation has conducted the research focusing on the key technologies in H.264 based wireless video communication system.The contents of the task are mainly composed of fast macroblock(MB) mode selection,rate control and error resilience coding in video encoder; unequal error protection(UEP) in channel encoder;fast mode derivation of the enhancement layer MB in extended spaticial scalability(ESS) and drift resistance in fine granularity scalability(FGS) in H.264/AVC scalable video coding(SVC) extension.Our works try to decrease the computational complexity of H.264 encoder to adapt the calculation ability of mobile terminals,solve the problems of robust transmission of H.264 video over error-prone wireless networks as well as enable flexible applications over heterogeneity networks.
     The contents and innovations of this dissertation are as follows. First,we describe the architecture of H.264/AVC based wireless video communication system,process statistical analyses on MB/sub_MB mode in H.264 streams as well as some important encoding parameters and draw some conclusions which are foundations of our following proposed algorithms.Next,we propose a fast intra prediction algorithm (?) reduce the computational complexity of encoding intra(I) frame, (?)nd a fast MB mode decision algorithm to reduce the complexity of (?)coding predict(P) and bi-predict(B) frames.Again,we propose a solution for wireless video communication which adopts the rate control associate with the error resilience encoding and UEP motivated by the joint source and channel coding(JSCC).Finally,in SVC extension (?) H.264/AVC,we proposed an efficient method to reduce the computational complexity of the mode derivation process of the hancement-layer MBs in ESS as well as a local adaptation of leak factorαused in the leaky prediction scheme in adaptive reference FGS (AR-FGS) respectively,which both depend on the motion and texture characteristics of the co-located local MBs in the base layer.
引文
[1]ITU-T and ISO/IEC JTC 1,ITU-T Recommendation H.264 and ISO/IEC 14496-10(MPEG-4 AVC).Advanced video coding for generic audiovisual services.May 2003.
    [2]Reichel J,Schwarz H,Wien M.Joint scalable video model JSVM-8[EB/OL].(2006-10-20).http://ftp3.itu.ch/av-arch/jvt-site/2006_07_Klagenfurt/JVT-T202.zip.
    [3]毕厚杰.新一代视频压缩编码标准-H.264/AVC[M].北京:人民邮电出版社,2005.
    [4]Stuhlm(u|¨)ller K,F(a|¨)rber N,Link M,et al.Analysis of video transmission over lossy channels[J].IEEE Journal on Selected Areas in Communications,2000,18(6):1012-1032.
    [5]Stockhammer T,Hannuksela M M,Wiegand T.H.264/AVC in wireless environments[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):657-673.
    [6]Varsa V,Karczewicz M,Roth G,et al.Common test conditions for RTP/IP over 3GPP/3GPP2[EB/OL].(2002-06-15).http://ftp3.itu.ch/av-arch/jvt-site/0109_San/VCEG-N80.zip.
    [7]Pan F,Lin X,Susanto R,et al.Fast mode decision algorithm for intra prediction[EB/OL].(2003-3-15).http://ftp3.itu.ch/av-arch/jvt-site/2003_03_Pattaya/JVT-G013.zip.
    [8]Jeon B,Lee J.Fast mode decision for H.264[EB/OL].(2003-12-03).http://ftp3.itu.ch/av-arch/jvt-site/2003_12_Waikoloa/JVT-J033.zip.
    [9]Jeon B,Lee J.Fast mode decision for B slice[EB/OL].(2004-3-10).http://ftp3.itu.ch/av-arch/jvt-site/2004_03_Munich/JVT-K021.zip.
    [10]Wang X L,Ridge J.Improvement of macroblock mode prediction in ESS [EB/OL].(2007-01-16).http://ftp3.itu.ch/av-arch/jvt-site/2007_01_Marrakech/JVT-V108.zip.
    [11]Kamp S,Wien M.Improved adaptation and coding of leak factor in AR-FGS [EB/OL].(2006-07-18).http://ftp3.itu.ch/av-arch/jvt-site/2006_07_Klagenfurt/JVT-T062.zip.
    [12]Wiegand T,Sullivan G J,Bjφntegaard G,et al.Overview of the H.264/AVC video coding standard[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):560-576.
    [13]Malvar H S,Hallapuro A,Karczewicz M,et al.Low-complexity transform and quantization in H.264/AVC[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):598-603.
    [14]List P,Joch A,Lainema J,et al.Adaptive deblocking filter[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):614-619.
    [15]Marpe D,Schwarz H,Wiegand T.Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):620-636.
    [16]Shannon C E.A mathematical theory of communication[J].The Bell System Technical Journal,1948.27(7):379-423.27(10):623-656.
    [17]蔡安妮,孙景鳌.多媒体通信技术基础[M].北京:电子工业出版社,2000.
    [18]Flierl M,Girod B.Generalized B pictures and the draft H.264/AVC video-compression standard[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):587-597.
    [19]Liu X W,Wang D L,Srivastava A.Image segmentation using local spectral histograms[C]//Proc.of IEEE ICIP'01,Thessaloniki:IEEE Press,2001:70-73.
    [20]Puri a,Chen X,Luthra A.Video coding using the H.264/MPEG-4 AVC compression standard[J].Signal Processing:Image Communication,2004,19:793-849.
    [21]Wiegand T,Schwarz H J,Joch A,et al.Rate-constrained coder control and comparison of video coding standards[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):688-703.
    [22]JVT reference software[EB/OL].(2006-1-22).http://iphome.hhi.de/suehring/tml/download/old_im/jm10.1.zip,jm11.0.zip,jm12.4.zip.
    [23]Halbach T.Performance comparison:H.26L intra coding vs.JPEG2000[EB/OL].(2002-7-15).http://ftp3.itu.ch/av-arch/jvt-site/2002_07_Klagenfurt/JVT-D039.doc.
    [24]Pan F,Lin X,Rahardja S,et al.Fast mode decision algorithm for intraprediction in H.264/AVC video coding[J].IEEE Transactions on Circuit and System for Video Technology,2005,15(7):813-822.
    [25]李世平,蒋刚毅,郁梅.快速帧内预测模式选择新方法[J].电子学报,2006,34(1):141-146.
    [26]苏睿,刘贵忠,张彤宇,等.利用变换域信息快速实现H.264帧内预测编码的新算法[J].电子与信息学报,2007,29(1):161-165.
    [27]贾克斌,谢晶,方晟.一种基于自相关法的H.264/AVC高效帧内预测算法[J].电子学报,2006,34(1):152-154.
    [28]滕国伟,王国中,张兆扬,等.一种基于自适应阈值的H.264/AVC帧内预测模式快速选择算法[J].自动化学报,2006,32(4):526-533.
    [29]Cheng Ch-Ch,Chang T-S.Fast three step intra prediction algorithm for 4×4blocks in H.264[C]//Proc.of IEEE ISCAS'05,Kobe:IEEE Press,2005:1509-1512.
    [30]Lim K P,Wu S,Wu D J,et al.Fast inter mode selection[EB/OL].(2003-8-19) http://ftp3.itu.ch/av-arch/jvt-site/2003_09_SanDiego/JVT-I020.zip.
    [31]Wu D,Pan F,Lim K P,et al.Fast intermode decision in H.264/AVC video coding[J].IEEE Transactions on Circuit and System for Video Technology,2005,15(6):953-958.
    [32]滕国伟,张兆扬,张一钧,等.一种基于H.264/AVC的帧间模式快速判决算法[J].光电子·激光,2005,16(7):866-870.
    [33]王淑慧,林涛,林争辉.H.264中基于统计分析的快速帧间、帧内模式选择算法[J].上海交通大学学报,2007,41(1):153-156.
    [34]宋彬,常义林,李春林.H.264帧间预测模式的快速选择算法[J].电子学报,2007,35(4):697-700.
    [35]刘峰.视频图像编码技术及国际标准[M].北京:北京邮电大学出版社,2005.
    [36]Li Z G,Pan F,Lim K P,et al.Adaptive basic unit layer rate control for JVT[EB/OL].(2003-3-12).http://ftp3.itu.ch/av-arch/jvt-site/2003_03_Pattaya/JVT-G012.zip.
    [37]Li Z G,Gao W,Pan F,et al.Adaptive rate control with HRD consideration [EB/OL].(2002-12-8).http://ftp3.itu.ch/av-arch/jvt-site/2003_05Geneva/JVT-H014.zip.
    [38]Ribas-Corbera J,Chou P A,Regunathan S L.A generalized hypothetical reference decoder for H.264/AVC[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):674-687.
    [39]Wu Y,Lin S X,Zhang Y D,et al.Optimum bit allocation and rate control for H.264/AVC[EB/OL].(2005-4-18).http://ftp3.itu.ch/av-arch/jvt-site/2005_04_Busan/JVT-O016.zip.
    [40]Jiang M Q,Ling N.Low-delay rate control for real-time H.264/AVC video coding[J].IEEE Transactions on Multimedia,2006,8(3):467-477.
    [41]刘峰,缪陆军,徐浩.基于编码复杂度的帧层和宏块层自适应码流控制方法[J].南京邮电大学学报,2006,12(6):21-26.
    [42]陈梅丽,刘鹏,姚庆栋.面向H.264/AVC的宏块级码率控制算法[J].浙江大学学报(工学版),2006,12(6):925-929.
    [43]Liu Y,Li Z G,Soh Y C.A novel rate control scheme for low delay video communication of H.264/AVC standard[J].IEEE Transactions on Circuit and System for Video Technology,2007,17(1):68-78.
    [44]余成伟,陆建华,郑君里.基于场景切换的H.264码率控制技术[J].清华大学学报(自然科学版),2007,47(7):1133-1136.
    [45]Wenger S.H.264/AVC over IP[J].IEEE Transactions on Circuit and System for Video Technology,2003,13(7):645-656.
    [46]Bandyopadhyay S,Wu Z,Pandit P,et al.Frame loss error concealment for H.264/AVC[EB/OL].(2005-7-26).http://ftp3.itu.ch/av-arch/jvt-site/2005_07_Poznan/JVT-P072.zip.
    [47]Dung N D,Fernando W A C.Unequal error protection for H.26L video transmission[C]//Proc.of IEEE WPMC' 02.Honolulu:IEEE Press,2002:821-825.
    [48]Raibroycharoen P,Ghandi M M,Jones E V,et al.Performance analysis of H.264/AVC video transmission with unequal error protected turbo codes [C]// Proc.of IEEE VTC' 05-spring.Colchester:IEEE Press,2005:1580-1584.
    [49]秦晓芳,隋东,王翯,等.联合HARQ与H.264的无线视频传输[J].北京邮电大学学报,31(1),2008:79-83.
    [50]王永芳,余松煜.基于LDPC的不均等错误保护H.264抗误码算法[J].系统工程与电子技术,28(11):1637-1640.
    [51]王薇,刘文予,金欣,等.无线视频通信中的自适应差错非均匀保护方案[J].微电子学与计算机,2004,21(7):53-57.
    [52]Thomos N,Argyropoulos S,Boulgouris N V,et al.Robust transmission of H.264/AVC video using adaptive slice grouping and unequal error protection[C]// Proc.of IEEE ICME' 06.Toronto:IEEE Press,2006:593-596.
    [53]艾达,常义林,罗忠,等.基于对象的H.264视频编码抗分组丢失方法[J].西安电子科技大学学报,2006,33(4):524-528.
    [54]Qu Q,Pei Y,Modestino J W.An adaptive motion-based unequal error protection approach for real-time video transport over wireless IP networks [J].IEEE Transactions on Multimedia,2006,8(5):1033-1044.
    [55]陈川,余松煜.联合编码模式选择的码率控制算法[J].电子学报.2004,32(5):763-768.
    [56]陈川,余松煜,熊红凯.丢包网络中鲁棒的视频码率控制算法[J].上海交通大学学报.2004,38(12):2019-2025.
    [57]Xiong H K,Sun J,Yu S Y,et al.Rate control for real-time video network transmission on end-to-end rate-distortion and application-oriented QoS[J]. IEEE Transactions on Broadcasting,2005,51(1):122-132.
    [58]杨天武,彭强,诸昌钤.H.264视频鲁棒传输的最优宏块模式选择[J].电子科技大学学报,2006,35(5):755-758.
    [59]Robertson P,Villebrun E,Hoeher P.A comparison of optimal and sub-optimal map decoding algorithms operating in the log domain[C]//Proc.of IEEE ICC' 95.Seattle:IEEE Press,1995:1009-1013.
    [60]Schwarz H,Marpe D,Wiegand T.Overview of the scalable video coding extension of the H.264/AVC standard[J].IEEE Transactions on Circuit and System for Video Technology,2007,17(9):1103-1120.
    [61]Ohm J R.Advances in scalable video coding[J].Proceedings of the IEEE,2005,93(1):42-56.
    [62]Mathias W,Schwarz H,Oelbaum T.Performance analysis of SVC[J].IEEE Transactions on Circuit and System for Video Technology,2007,17(9):1194-1203.
    [63]Sullivan G J,Segall C A.Spatial scalability within the H.264/AVC scalable video coding extension[J].IEEE Transactions on Circuit and System for Video Technology,2007,17(9):1121-1135.
    [64]Wiegand T,Sullivan G,Reichel J,et al.Joint draft 9 of SVC amendment [EB/OL].(2006-10-22).http://ftp3.itu.ch/av-arch/jvt-site/2006_10_Hangzhou/JVT-U201.zip.
    [65]Li H,Li Z G,Wen C Y.Fast mode decision algorithm for inter frame coding in fully scalable video coding[J].IEEE Transactions on Circuit and System for Video Technology,2006,7(16):889-895.
    [66]Wang X.Core experiment on improving ESS[EB/OL].(2007-01-16).http://ftp3.itu.ch/av-arch/jvt-site/2007_01_Marrakech/JVT-V302.zip.
    [67]Vieron J,Wien M,Schwarz H.JSVM 10 software[EB/OL].(2007-04-23).http://ftp3.itu.ch/av-arch/jvt-site/2007_04_SANJOSE/JVT-W203.zip.
    [68]Khamadja M,Benierbah S.A new technique for quality scalable video coding with H.264[J].IEEE Transactions on Circuit and System for Video Technology,2005,15(11):1332-1340.
    [69]Bao Y L,Karczewicz M,Ridge J,et al.Improvements to fine granularity scalability for low-delay applications[EB/OL].(2005-04-20).http://ftp3.itu.ch/av-arch/jvt-site/2005_10_Busan/JVT-O054.zip.
    [70]Bao Y L,Karczewicz M,Wang X L,et al.FGS coding with adaptive reference for low-delay applications[C]//Proc.of IEEE ICIP' 06,Altanta:IEEE Press,2006:185-188.
    [71]Bao Y L,Karczewicz M.CE7 Report,FGS coding for low-delay applications [EB/OL].(2005-10-16).http://ftp3.itu.ch/av-arch/jvt-site/2005_10_Nice/JVT-Q039.zip.
    [72]Kamp S,Wien M.Local adaptation of leak factor in AR-FGS[EB/OL].(2006-04-02).http://ftp3.itu.ch/av-arch/jvt-site/2006_03_Geneva/JVT-S092.zip.
    [73]Park G H,Jeong S,Park D Y,et al.Leakry factor overriding in skip mode for AR-FGS[EB/OL].(2006-07-18).http://ftp3.itu.ch/av-arch/jvt-site/2006_07_Klagenfurt/JVT-T021.zip.
    [74]Kamp S,Wien M.Improved adaptation and coding of leak factor in AR-FGS [EB/OL].(2006-07-18).http://ftp3.itu.ch/av-arch/jvt-site/2006_07_Klagenfurt/JVT-T062.zip.
    [75]Kamp S,Wien M.CE5:Results for JVT-T062[EB/OL].(2006-10-22).http://ftp3.itu.ch/av-arch/jvt-site/2006_10_Hangzhou/JVT-U055.zip.
    [76]Cieplinski L.Motion vectors based adaptation of leak factor for AR-FGS [EB/OL].(2006-07-18).http://ftp3.itu.ch/av-arch/jvt-site/2006_07_Klagenfurt/JVT-T078.zip.
    [77]Jeong S,Kamp S,Wang X L,et al.CE 5:Improvement of AR PR slices [EB/OL].(2006-07-18).http://ftp3.itu.ch/av-arch/jvt-site/2006_07_Klagenfurt/JVT-T305.zip.
    [78]Schierl T,Stockhammer T,Wiegand T.Mobile video transmission using scalable video coding[J].IEEE Transactions on Circuit and System for Video Technology,2007,17(9):1218-1226.
    [79]Song D,Chen C W.Scalable H.264/AVC video transmission over MIMO wireless systems with adaptive channel selection based on partial channel information[J].IEEE Transactions on Circuit and System for Video Technology,2007,17(9):1218-1226.
    [80]Wien M,Cazoulat R,Graffunder A,et al.Real-time system for adaptive video streaming based on SVC[J].IEEE Transactions on Circuit and System for Video Technology,2007,17(9):1227-1237.
    [81]Hsiang S T.Intra-frame dyadic spatial scalable coding based on a subband/wavelet framework for MPEG-4 AVC/H.264 scalable video coding [C]// Proc.of IEEE ICIP' 07,San Antonio:IEEE Press,2007:73-76.
    [1]盛骤,谢式千,潘承毅.概率论与数理统计(第2版)[M],北京:高等教育出版社,1989.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700