H.264快速模式选择算法研究
|
摘要
本文研究内容主要围绕着最新视频编码标准H.264/AVC中的帧内编码算法和帧间编码算法两部分展开的。帧内编码和帧间编码是视频编码的重要组成部分,目前这两部分的算法过于复杂,不适合应用于对实时性要求较严格的领域。本文针对于这两部分存在的问题,对预测策略进行了改进,分别提出了一种快速算法,通过改进后的快速算法能够有效的降低计算复杂度,提高编码效率。
基于此,本文进行了如下的研究工作：
首先研究了视频编码标准的发展,H.264标准的系统组成、帧间预测、帧内预测、整数变换及量化、熵编码、率失真优化等关键技术。
其次,对现有的H264的帧内预测模式算法进行了详细的分析。利用相邻块的预测模式之间的相关性以及相关预测模式之间编码的特点,提出了一种基于阈值的快速帧内模式选择算法。该算法可以根据阈值,确定是否可以将最可能的预测模式作为最终的预测结果,排除大量的无用的帧内预测模式,避免了很多不必要的代价计算。最后,经过大量的编码实现和实验,以及与原始算法的对比表明,该算法能有效降低帧内预测的复杂度,同时基本保持了H.264的编码性能,并且具有很好的自适应性。
最后,对已有的快速帧间模式选择算法进行分析和研究后,利用3种典型帧间块编码模式的率失真优化值的单调性提出了一种快速的帧间块编码模式选择方法,而对于P帧编码来说,在确定了最佳帧间块编码模式后还需要与最佳帧内块编码模式下的率失真优化值进行比较,以便确定待编码的帧间块最后是选用帧间还是帧内编码模式,为此,又提出了一种快速的帧内是否需要帧间编码模式的判决方法。把以上方法综合运用到H.264编码器中,大大降低了其模式选择算法实现的复杂度。
This paper focus on Intra and inter-frame coding algorithms of the latest video coding standard H.264/AVC.Intra-frame coding and inter-frame coding are important part of video encoding.Currently,these two algorithms are too complex and not suitable for real time video coding.For in these issues,this paper improves the prediction strategy and proposes a fast algorithm respectively.The improved fast algorithm can effectively reduce the computational complexity and improve coding efficiency.
In order to achieve high encoding efficiency, H.264 uses a great deal of encoding algorithms with high complexity. These complexity algorithms will limit the application of H.264 in real time video coding.So we must find corresponding fast algorithms to replace those with high complexity in H.264 reference software. According to above ideas, this dissertation gives deep research on Fast Mode Selection Algorithms and the implementation of H.264 encoder under the reference in PC with high speed and efficiency.
According to the above ideas,this dissertation conducts the following studies Firstly, we researched the development of the video coding standard and discuss the key technique of H.264, including system composition, inter-prediction, intra-Prediction,integer transform,entropy coding, rate distortion optimization and so on. Secondly, we analyze the existing intra prediction mode algorithm in detail,we propose a fast intra mode selection algorithm based on threshold by utilizing the relationships of prediction modes of neighbor blocks and the coding characters of the relevant prediction modes.Based on the threshold,this algorithm can determine whether the most probable mode can be selected as the final forecasting resul,and it excludes massive useless intra prediction modes and avoids many unnecessary computations about costs. In the last, by having many times of coding accomplishment and experiments,and comparing with the original algorithm,it can be demonstrated that this algorithm can decreases the complexity of the intra prediction effectively, at the same time,it maintains the coding performance fundamentally, and has a favorable adaptive ability.
Finally,through analysis of the existing fast intra prediction mode algorithm, this paper propose a fast inter-frame block coding mode selection method by using the monotonicity of the optimized value of rate-distortion of three typical kinds of inter-frame block coding modes.But for the P-frame coding, Comparison with the optimized value of rate-distortion of The best intra-block coding mode is needed after determining the best inter-frame block coding model,in order to determine the block to be encoded with inter-frame or intra-frame coding mode.The complexity of H.264's mode selection will be grately reduced when the above methods are adopted.
基于此,本文进行了如下的研究工作：
首先研究了视频编码标准的发展,H.264标准的系统组成、帧间预测、帧内预测、整数变换及量化、熵编码、率失真优化等关键技术。
其次,对现有的H264的帧内预测模式算法进行了详细的分析。利用相邻块的预测模式之间的相关性以及相关预测模式之间编码的特点,提出了一种基于阈值的快速帧内模式选择算法。该算法可以根据阈值,确定是否可以将最可能的预测模式作为最终的预测结果,排除大量的无用的帧内预测模式,避免了很多不必要的代价计算。最后,经过大量的编码实现和实验,以及与原始算法的对比表明,该算法能有效降低帧内预测的复杂度,同时基本保持了H.264的编码性能,并且具有很好的自适应性。
最后,对已有的快速帧间模式选择算法进行分析和研究后,利用3种典型帧间块编码模式的率失真优化值的单调性提出了一种快速的帧间块编码模式选择方法,而对于P帧编码来说,在确定了最佳帧间块编码模式后还需要与最佳帧内块编码模式下的率失真优化值进行比较,以便确定待编码的帧间块最后是选用帧间还是帧内编码模式,为此,又提出了一种快速的帧内是否需要帧间编码模式的判决方法。把以上方法综合运用到H.264编码器中,大大降低了其模式选择算法实现的复杂度。
This paper focus on Intra and inter-frame coding algorithms of the latest video coding standard H.264/AVC.Intra-frame coding and inter-frame coding are important part of video encoding.Currently,these two algorithms are too complex and not suitable for real time video coding.For in these issues,this paper improves the prediction strategy and proposes a fast algorithm respectively.The improved fast algorithm can effectively reduce the computational complexity and improve coding efficiency.
In order to achieve high encoding efficiency, H.264 uses a great deal of encoding algorithms with high complexity. These complexity algorithms will limit the application of H.264 in real time video coding.So we must find corresponding fast algorithms to replace those with high complexity in H.264 reference software. According to above ideas, this dissertation gives deep research on Fast Mode Selection Algorithms and the implementation of H.264 encoder under the reference in PC with high speed and efficiency.
According to the above ideas,this dissertation conducts the following studies Firstly, we researched the development of the video coding standard and discuss the key technique of H.264, including system composition, inter-prediction, intra-Prediction,integer transform,entropy coding, rate distortion optimization and so on. Secondly, we analyze the existing intra prediction mode algorithm in detail,we propose a fast intra mode selection algorithm based on threshold by utilizing the relationships of prediction modes of neighbor blocks and the coding characters of the relevant prediction modes.Based on the threshold,this algorithm can determine whether the most probable mode can be selected as the final forecasting resul,and it excludes massive useless intra prediction modes and avoids many unnecessary computations about costs. In the last, by having many times of coding accomplishment and experiments,and comparing with the original algorithm,it can be demonstrated that this algorithm can decreases the complexity of the intra prediction effectively, at the same time,it maintains the coding performance fundamentally, and has a favorable adaptive ability.
Finally,through analysis of the existing fast intra prediction mode algorithm, this paper propose a fast inter-frame block coding mode selection method by using the monotonicity of the optimized value of rate-distortion of three typical kinds of inter-frame block coding modes.But for the P-frame coding, Comparison with the optimized value of rate-distortion of The best intra-block coding mode is needed after determining the best inter-frame block coding model,in order to determine the block to be encoded with inter-frame or intra-frame coding mode.The complexity of H.264's mode selection will be grately reduced when the above methods are adopted.
引文
[1]刘峰.视频图像编码技术及国际标准,北京邮电大学出版社,2005,1-246
[2]Girod B,Steinbach E, Farber N. Performance of the H.263 video compression standard.Journal of VLSI Signal Processing,1997,17(2):101-111
[3]Tambankar A, Rao KR.An Overview of H.264/MPEG-4 Part10.Video/Image Processing and Multimedia Communication,2003,4-8
[4]毕厚杰.新一代视频压缩编码标准—H.264／AVC,人民邮电出版社,2005,84-85
[5]MPEG. MPEG-2 Test Model 5.http://www.mpeg.org/MPEG/MSSG/tm5/Ch10/ Ch10. html,1993
[6]余胜生,苏曙光,周敬利.基于H.26L多参考帧运动估计的研究及其新算法[J].计算机工程,2005,6(4)：176-178
[7]张晓飞,彭强,桂曼.H.264／AVC快速帧间编码算法.华东交通大学学报,2006,2(23)：16-19
[8]林叶,彭强.一种H.264帧内模式选择算法.成都信息工程学院学报,2007,1(22)：22-26
[9]张江鑫,冯明.H.264快速帧内预测模式选择算法.中国图像图形学报,2008,10(13)：10-13
[10]Navakitanok P, Aramvith S.Improved rate control for advanced video coding(AVC) standard under low delay constraint. In Proceeding of the International Conference on information Technology;Coding and Computing, 2004,664-668
[11]喻占武,黄晓杰.适用于H.264的高性能快速运动估计算法.武汉大学学报(信息科学版),2004,5(29)：466-469
[12]张翔,喻占武.H.264标准的码率控制算法研究.武汉大学学报(信息科学版),2004,12(29)：43-44
[13]Wenger S.H.264/AVC over IP. IEEE Transactions on Circuits and Systems for Video Technology.2003,13(7):645-656
[14]Stockhammer T, Hannuksela M, Wigand T. H.264/AVC in Wireless Environments. IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7): 657-673
[15]Wedi T. Motion compensation in H.264/AVC.IEEE Transactions on Circuits and Systems for Video Technology,2003.13(7):577-586
[16]熊成玉,何芸.基于率失真理论的视频编码码率控制.通信学报,1997,18(5)：8-24
[17]Girod B,Flierl M. Multi-Frame Motion-Compensated Video Compression for the Digital Set-Top Box,in ICIP 2002,87-96
[18]Wiegand T, Zhang X, Girod B.Long-term Memory Motion-compensated Prediction,IEEE Transactions on Circuits and Systems for Video Technology. 1999,9(1):70-84
[19]Marpe D, Blattermann G, Wiegand T. Adaptive codes for H.26L. JVT Document VCEG-L13.doc,2001,6-16
[20]Joch, Anthony, Kossentini. Faousi,HallaPuro.Antti,"H.264/AVCB aselineProfie
[21]Decoder ComPlexity Analysis",IEEE Trans.Circuits Sys;Video Technol,2003, (13):704-716
[22]Iain E G Richardson.H.264/MPEG-4 Part10:Transform&Quantization[EB] www. vcdex.com, Apr.2003,50-100
[23]Ortega and K. Ramchandram.Rate-distortion methods for image and video compression.IEEE Signal Processing Mag, vol.15,pp.23-50, Nov.1998
[24]Sullivan G.J,wiegand T. Rate-Distortion Optimization for Video Compression, IEEE Signal Processing Mag.1998,15(11):74-90
[25]Choi J,Park D.A Stable Feedback Control of the Buffer State Using the Controlled Lagrange Multiplier Method IEEE Trns.1996,5-169
[26]Bojum Meng,Oscar C.Au.Fast Intra-prediction Mode Selection for 4x4 Blocks in H.264. IEEE Internation Conference on Acoustics,Speech and Signal Proceedings,2003,V3:389-392
[27]ISO/IEC.ISO/IEC JTC1/SC29/WG11 N3908.MPEG-4 Video Verification Model Version 18.0.2001,299-311
[28]周宁兆,宋彬.H.264中帧内编码算法及其快速实现研究.中国有线电视,2004,24(4)：9-13
[29]袁基炜,李国辉.H.264帧内预测快速算法.计算机测量与控制,2008,16(3)：20-22
[30]王斌,常建文.改进的H.264快速帧内预测模式选择算法.计算机测量与控制,2008,34(19)：228-229
[31]王嵩,刘济林,薛全等.H.264／AVC中基于全零块检测的运动估计快速算法.电路与系统学报,2005,10(1)：10-14
[32]K. P. Lim,S.Wu,et al.Fast Inter Mode Selection.Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-I020,2003
[33]D.Wu,S.Wu, K.P.Lim,et al.Block inter mode decision for fast encoding of H.264. ICASSP 2004,181-184
[34]Byeungwoo Jeon, Jeyun Lee.Fast Mode Decision for H.264.Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-I033,2003
[35]田传艳,沈承东,李思昆.一种有效的基于上下文自适应搜索模式的快速运动估计算法.国防科技大学,2005,2(27)：291-292
[36]Qiang Wang, Debin Zhao, et al.Low complexity RDO mode decision based on a fast coding-bits estimation model for H.264/AVC. IEEE International Symposium on Circuits and Systems(ISCAS 2005), Kobe, Japan,2005:3467-3470
[37]Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG.Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification(ITU-T Rec.H.264 ISO/IEC 14496-10 AVC), document JVT-G050d35.doc,7th Meeting:Pattaya, Thailand, March,2003
[38]郭建军,戴葵,成运,王志英.H.264中块分割模式选择算法研究.计算机科学,2005,32(11)：25-27
[39]Yun Cheng, Zhiying Wang, Kui Dai and Jianjun Guo.Analysis of inter-frame coding without intra modes in H.264/AVC[C].Eurographics Workshop on Multimedia(2004),2004,24-28
[40]成运,戴葵,王志英.H.264／AVC帧间多种块模式的编码性能分析与研究.计算机工程与应用,2005,41(5)：33-36
[41]李庚谦.H.264快速帧内预测算法研究：[西安电子科技大学硕士学位论文].西安：西安电子科技大学,2007,36-46
[42]刘奎.H.264视频编码帧间帧内算法研究：[河海大学硕士学位论文].江苏：河海大学,2007,32-38
[43]喜超,H.264视频编码中帧间编码的研究：[西安电子科技术大学硕士学位文].西安：西安电子科技术大学,2006,16-43
[44]王丽丽.H.264／AVC中帧内编码和帧间编码技术研究：[山东大学硕士学位论文].山东：山东大学,2007,28-47
[2]Girod B,Steinbach E, Farber N. Performance of the H.263 video compression standard.Journal of VLSI Signal Processing,1997,17(2):101-111
[3]Tambankar A, Rao KR.An Overview of H.264/MPEG-4 Part10.Video/Image Processing and Multimedia Communication,2003,4-8
[4]毕厚杰.新一代视频压缩编码标准—H.264／AVC,人民邮电出版社,2005,84-85
[5]MPEG. MPEG-2 Test Model 5.http://www.mpeg.org/MPEG/MSSG/tm5/Ch10/ Ch10. html,1993
[6]余胜生,苏曙光,周敬利.基于H.26L多参考帧运动估计的研究及其新算法[J].计算机工程,2005,6(4)：176-178
[7]张晓飞,彭强,桂曼.H.264／AVC快速帧间编码算法.华东交通大学学报,2006,2(23)：16-19
[8]林叶,彭强.一种H.264帧内模式选择算法.成都信息工程学院学报,2007,1(22)：22-26
[9]张江鑫,冯明.H.264快速帧内预测模式选择算法.中国图像图形学报,2008,10(13)：10-13
[10]Navakitanok P, Aramvith S.Improved rate control for advanced video coding(AVC) standard under low delay constraint. In Proceeding of the International Conference on information Technology;Coding and Computing, 2004,664-668
[11]喻占武,黄晓杰.适用于H.264的高性能快速运动估计算法.武汉大学学报(信息科学版),2004,5(29)：466-469
[12]张翔,喻占武.H.264标准的码率控制算法研究.武汉大学学报(信息科学版),2004,12(29)：43-44
[13]Wenger S.H.264/AVC over IP. IEEE Transactions on Circuits and Systems for Video Technology.2003,13(7):645-656
[14]Stockhammer T, Hannuksela M, Wigand T. H.264/AVC in Wireless Environments. IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7): 657-673
[15]Wedi T. Motion compensation in H.264/AVC.IEEE Transactions on Circuits and Systems for Video Technology,2003.13(7):577-586
[16]熊成玉,何芸.基于率失真理论的视频编码码率控制.通信学报,1997,18(5)：8-24
[17]Girod B,Flierl M. Multi-Frame Motion-Compensated Video Compression for the Digital Set-Top Box,in ICIP 2002,87-96
[18]Wiegand T, Zhang X, Girod B.Long-term Memory Motion-compensated Prediction,IEEE Transactions on Circuits and Systems for Video Technology. 1999,9(1):70-84
[19]Marpe D, Blattermann G, Wiegand T. Adaptive codes for H.26L. JVT Document VCEG-L13.doc,2001,6-16
[20]Joch, Anthony, Kossentini. Faousi,HallaPuro.Antti,"H.264/AVCB aselineProfie
[21]Decoder ComPlexity Analysis",IEEE Trans.Circuits Sys;Video Technol,2003, (13):704-716
[22]Iain E G Richardson.H.264/MPEG-4 Part10:Transform&Quantization[EB] www. vcdex.com, Apr.2003,50-100
[23]Ortega and K. Ramchandram.Rate-distortion methods for image and video compression.IEEE Signal Processing Mag, vol.15,pp.23-50, Nov.1998
[24]Sullivan G.J,wiegand T. Rate-Distortion Optimization for Video Compression, IEEE Signal Processing Mag.1998,15(11):74-90
[25]Choi J,Park D.A Stable Feedback Control of the Buffer State Using the Controlled Lagrange Multiplier Method IEEE Trns.1996,5-169
[26]Bojum Meng,Oscar C.Au.Fast Intra-prediction Mode Selection for 4x4 Blocks in H.264. IEEE Internation Conference on Acoustics,Speech and Signal Proceedings,2003,V3:389-392
[27]ISO/IEC.ISO/IEC JTC1/SC29/WG11 N3908.MPEG-4 Video Verification Model Version 18.0.2001,299-311
[28]周宁兆,宋彬.H.264中帧内编码算法及其快速实现研究.中国有线电视,2004,24(4)：9-13
[29]袁基炜,李国辉.H.264帧内预测快速算法.计算机测量与控制,2008,16(3)：20-22
[30]王斌,常建文.改进的H.264快速帧内预测模式选择算法.计算机测量与控制,2008,34(19)：228-229
[31]王嵩,刘济林,薛全等.H.264／AVC中基于全零块检测的运动估计快速算法.电路与系统学报,2005,10(1)：10-14
[32]K. P. Lim,S.Wu,et al.Fast Inter Mode Selection.Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-I020,2003
[33]D.Wu,S.Wu, K.P.Lim,et al.Block inter mode decision for fast encoding of H.264. ICASSP 2004,181-184
[34]Byeungwoo Jeon, Jeyun Lee.Fast Mode Decision for H.264.Joint Video Team(JVT) of ISO/IEC MPEG and ITU-T VCEG, JVT-I033,2003
[35]田传艳,沈承东,李思昆.一种有效的基于上下文自适应搜索模式的快速运动估计算法.国防科技大学,2005,2(27)：291-292
[36]Qiang Wang, Debin Zhao, et al.Low complexity RDO mode decision based on a fast coding-bits estimation model for H.264/AVC. IEEE International Symposium on Circuits and Systems(ISCAS 2005), Kobe, Japan,2005:3467-3470
[37]Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG.Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification(ITU-T Rec.H.264 ISO/IEC 14496-10 AVC), document JVT-G050d35.doc,7th Meeting:Pattaya, Thailand, March,2003
[38]郭建军,戴葵,成运,王志英.H.264中块分割模式选择算法研究.计算机科学,2005,32(11)：25-27
[39]Yun Cheng, Zhiying Wang, Kui Dai and Jianjun Guo.Analysis of inter-frame coding without intra modes in H.264/AVC[C].Eurographics Workshop on Multimedia(2004),2004,24-28
[40]成运,戴葵,王志英.H.264／AVC帧间多种块模式的编码性能分析与研究.计算机工程与应用,2005,41(5)：33-36
[41]李庚谦.H.264快速帧内预测算法研究：[西安电子科技大学硕士学位论文].西安：西安电子科技大学,2007,36-46
[42]刘奎.H.264视频编码帧间帧内算法研究：[河海大学硕士学位论文].江苏：河海大学,2007,32-38
[43]喜超,H.264视频编码中帧间编码的研究：[西安电子科技术大学硕士学位文].西安：西安电子科技术大学,2006,16-43
[44]王丽丽.H.264／AVC中帧内编码和帧间编码技术研究：[山东大学硕士学位论文].山东：山东大学,2007,28-47