基于H.264图像编码算法的研究及DSP实现
|
摘要
目前最新的视频编码标准H.264与以往视频编码标准相比具有无法比拟的优点,加之TI公司生产的高性能通用多媒体数字可编程处理器TMS320DM642超强的计算能力,很好地解决了H.264较高的算法复杂度对其在实时环境下应用的影响,是实现H.264编解码的理想平台。
本文分别针对H.264关键算法与DSP平台的移植和优化这两个方面展开工作。首先对H.264中采用的关键技术进行了分析,在此基础上,对于帧内算法,利用宏块自身的纹理特征来达到只计算一种宏块模式的目的;同时,利用帧内预测模式的方向性,减少了候选模式,从而达到对Intra4×4模式的快速选择。大大降低了标准算法中全搜索算法的复杂性。另外,在研究了全搜索算法、非对称十字型多层次六边形格点搜索算法(UMHexagonS)、三步搜索法等算法的基础上,采用复合搜索模板、初始点自动预测和早停止策略,提出了新的快速运动估计算法,减少了运动估计时间,提高了编码速度。
之后在DSP平台方面,依据TMSDM642与H.264编码器自身的结构特点,优化了片内存储器、合理分配存储空间、调整了的变量定义、头文件的改动,成功的实现了DSP平台的算法的移植;又利用编译器选项优化、数据打包技术、关键字等方法对H.264编码器代码进行了优化。
经过H.264关键算法与DSP平台两方面的优化,编码器在编码效果没有大的损失的情况下,编码速度得到极大的提高。通过验证,解码后的视频图像与原始图像相比,图像的质量没有明显的降低。
这些方法有效的降低了整个编码器的运行时间,为今后基于这个平台的软件开发提供了很好的借鉴。
Nowadays the H.264 is advanced than any other former standards, at the same time TI company produces the high-performance general multimedia digital programmable processor TMS320DM642, with super computing power. It is a good solution to the higher algorithm complexity seriously influenced its application in real-time environment. It is to realize the H.264 encoding the ideal platform.
The work of this paper is focused on the H.264 key algorithms and the DSP platform transplantation and optimize on the two aspects respectively.
Firstly, the key technology used in the H.264 are analyzed, then for the intra-frame algorithm, the texture characteristic is adopted to judge the best intra-frame prediction mode before coding, which achieve the only purpose of a macro block mode during the coding process. Meanwhile, direction of intra prediction mode is adopted to achieve the purpose of a macro block mode. In addition, the study of the full search algorithm asymmetric cross-shaped multi-level hexagonal grid search algorithm (UMHexagonS),three-step search algorithm, the using of complex search patterns, the initial point of automatic forecasting and early stop strategy, a new fast motion estimation algorithm is proposed which to reduce the motion estimation time and improve the coding efficiency.
Secondly, on the DSP platform, according to the structure of TMSDM642 and the H.264, this paper optimize on-chip memory, allocation of storage space to adjust the variable definitions and header file changes, Successful implementation of the DSP platform migration algorithm following Optimized using compiler options, data packaging technology, keyword, and other methods of the H.264 encoder is optimized.
Through the optimization of the H.264 and the DSP, the encoder results in no major loss of coding circumstances, greatly increase encoding speed. Validated, the decoded video image, compared with the original image, the image quality is not significantly reduced.
These method effectively reduce the running time of the encoder and provides a good reference for the future of software development based on this platform provides a good reference.
本文分别针对H.264关键算法与DSP平台的移植和优化这两个方面展开工作。首先对H.264中采用的关键技术进行了分析,在此基础上,对于帧内算法,利用宏块自身的纹理特征来达到只计算一种宏块模式的目的;同时,利用帧内预测模式的方向性,减少了候选模式,从而达到对Intra4×4模式的快速选择。大大降低了标准算法中全搜索算法的复杂性。另外,在研究了全搜索算法、非对称十字型多层次六边形格点搜索算法(UMHexagonS)、三步搜索法等算法的基础上,采用复合搜索模板、初始点自动预测和早停止策略,提出了新的快速运动估计算法,减少了运动估计时间,提高了编码速度。
之后在DSP平台方面,依据TMSDM642与H.264编码器自身的结构特点,优化了片内存储器、合理分配存储空间、调整了的变量定义、头文件的改动,成功的实现了DSP平台的算法的移植;又利用编译器选项优化、数据打包技术、关键字等方法对H.264编码器代码进行了优化。
经过H.264关键算法与DSP平台两方面的优化,编码器在编码效果没有大的损失的情况下,编码速度得到极大的提高。通过验证,解码后的视频图像与原始图像相比,图像的质量没有明显的降低。
这些方法有效的降低了整个编码器的运行时间,为今后基于这个平台的软件开发提供了很好的借鉴。
Nowadays the H.264 is advanced than any other former standards, at the same time TI company produces the high-performance general multimedia digital programmable processor TMS320DM642, with super computing power. It is a good solution to the higher algorithm complexity seriously influenced its application in real-time environment. It is to realize the H.264 encoding the ideal platform.
The work of this paper is focused on the H.264 key algorithms and the DSP platform transplantation and optimize on the two aspects respectively.
Firstly, the key technology used in the H.264 are analyzed, then for the intra-frame algorithm, the texture characteristic is adopted to judge the best intra-frame prediction mode before coding, which achieve the only purpose of a macro block mode during the coding process. Meanwhile, direction of intra prediction mode is adopted to achieve the purpose of a macro block mode. In addition, the study of the full search algorithm asymmetric cross-shaped multi-level hexagonal grid search algorithm (UMHexagonS),three-step search algorithm, the using of complex search patterns, the initial point of automatic forecasting and early stop strategy, a new fast motion estimation algorithm is proposed which to reduce the motion estimation time and improve the coding efficiency.
Secondly, on the DSP platform, according to the structure of TMSDM642 and the H.264, this paper optimize on-chip memory, allocation of storage space to adjust the variable definitions and header file changes, Successful implementation of the DSP platform migration algorithm following Optimized using compiler options, data packaging technology, keyword, and other methods of the H.264 encoder is optimized.
Through the optimization of the H.264 and the DSP, the encoder results in no major loss of coding circumstances, greatly increase encoding speed. Validated, the decoded video image, compared with the original image, the image quality is not significantly reduced.
These method effectively reduce the running time of the encoder and provides a good reference for the future of software development based on this platform provides a good reference.
引文
[1]张旭东. TI DSP在视频传输和处理中的应用[M].北京:电子工业出版社,2009.
[2]葛奇.基于DSP的H.264编码器的实现与优化[D].成都:电子科技大学,2009.
[3]余兆明.图像编码标准H.264技术[M].北京:人民邮电出版社,2006.
[4]毕厚杰.新一带视频压缩标准—H.264/AVC[M].第二版.北京:人民邮电出版社,2009.
[5]钟玉琢. MPEG-2运动图像压缩编码国际标准及MPEG的新进展[M].北京:清华大学出版社,2002.
[6]胡振.基于H.264无线视频编码算法的研究与DSP实现[D].扬州:扬州大学,2009.
[7] Joch A,Kossentini F,Nasiopoulos P.A Performance Analysis of the ITU-T Draft H.26L[c].Department of Electrical and Computer Engineering University of British Columbia.2002:1-12.
[8] Iain E.O.Richardson.H.264and MPEG-4 Video Compression[J]. John Wiley &Sons Inc,2003:159-162.
[9]王英坤,徐伯庆,杨华.高效帧内预测模式选择算法[J].计算机应用, 2008, 28: 183-186.
[10] Rui SU, Guizhong LIU,Tongyu ZHANG.Fast mode decision algorithm for intra prediction in H.264/AVC with integer transform and adaptive threshold[C].2006 IEEE International Conference on Acoustics, Speech and Signal Processing. New York:IEEE, 2007, 1: 11-27.
[11] Mohammed Golam Sarwer, Q.M. Jonathan Wu. Adaptive Search Area Selection of Variable Block-Size Motion Estimation ofH.264/AVC Video Coding Standard[C]. 2009 11th IEEE International Symposium on Multimedia, Canada: 2009, 100-105.
[12]楼剑,虞露.新一代的视频编解码标准-H.264[J].当代通信, 2003, 13(5): 27-32.
[13]李可.基于DSP的H.264/AVC编码器的设计与实现[D].北京:北京工业大学,2007.
[14] Itoh Y.Bi-directional Motion Vector Coding Using University VLC[J]. Image Communication, 1999:541-547.
[15] Iain E G Richardson, Context-Based Adaptive Arithmetic Coding (CABAC),H.264/MPEG4 Part 10 White Paper, Mar. 2003.
[16]汪纪锋,彭光辉. H.264/AVC帧内4×4块预测模式选择算法研究[J].重庆邮电大学学报(自然科学版), 2008, 20(5): 499-552.
[17] Feng PAN, Xiao LIN, Rahardja. Fast Mode Decision for Intra Prediction[C]. 7th Meeting: Pattaya II, Thailand: 2003: 201-210.
[18] Zhang JN,He YWj Yang SQ,Zhong YZ.A fast intra prediction method for H.264 video coding[J].SPIE-INT Soc Optical Engineering, 2003, 52(03): 753-761.
[19] Kim C,SH IH H2H,KUO C2CJ.Multistage mode decision for intra prediction in H.264 codec.[C]. 1 6th Annual Symposium Electric Imaging,Califormia: 2004: 321-336.
[20] Cheng CC,Chang TS.Fast three step intra prediction algorithm for 4x4 blocks[A]. IEEE International Symposium on Circuits and Systems, 2005: 1509:1512.
[21] Pan F,Lin X,Rahardja S.A Directional Field Based Fast Intra Mode Decision Algorithm for H.264 Video Coding[C].IEEE International Conference on Multimedia and Expo(ICME 2004),Taibei,Taiwan, 2004, TP l-4: 1147-1150.
[22] Yongdong ZHANG,DaiFeng,Shouxun LIN.fast 4x4 Intra prediction Mode election for H.264[C]. IEEE International Conference on Multimedia and Expo. 2004, 2: l151-1155.
[23] Wang JC,Wang JF,Yang JF,Chen JT.A fast mode decision algorithm and its VISI design for H.264/AVC intra-prediction[J]. IEEE Transactions on Circuits and Systems for Video Technology. 2007, 17(10): 1414-1422.
[24]刘佳,董金明.一种新的H.264/AVC快速帧内预测模式选择判决算法[J].电子与信息学报, 2009, 31(5): 1072-1075.
[25]赵杰. H 264/AVC帧内预测算法优化研究[D].南京:南京邮电大学,2008.
[26] DO QUAN. Fast Intra Prediction Mode Decision For H.264/AVC[J].ICICE Trans.Inf.&Syst, 2010, 7: 2012-2015.
[27] Do Quan, Yo-Sung Ho. Categorization for Fast Intra Prediction Mode Decision IN H.264/AVC[J]. IEEE Transactions on Consumer Electronics, 2010, 56(2): 1049:1055.
[28] Jen-Shiun Chiang, Chih-Hsien Hsia, Tsai-Yuan Teng. Fast Intra Prediction Mode Decision Algorithm for 4×4 Blocks in H.264/ MPEG-4 AVC[J]. Tamkang Journal of Science and Engineering, 2008, 11(1): 49-54.
[29]曾焕强,蔡灿辉. H.264/AVC快速帧内预测模式选择算法[C].第十三届全嗣图象图形学学术会议,南京: 130-133.
[30]江根.基于H.264的运动估计算法的研究与优化[D].武汉:武汉理工大学,2009.
[31]侯文博.基于H.264的运动估计算法研究[D].哈尔滨:哈尔滨工程大学,2009.
[32] Koga T,linuma K , Hirano A et a1.Motion-compensated inter frame coding for video conferencing[J].Proc NTC81,New.Orleans,LA. 1981,11, C9.6.1-9.6.5.
[33] R Li,B Zeng,M L Liou.A new three-step search algorithm for block motion estimation[J].IEEE Transactions on Circuits and Systems for Video Technology, 1994, 4(4): 438-442.
[34] J.Y Tham,S.Ranganath,M.Ranganath,et a1.A novel unrestricted center-biased diamond search algorithm for block motion estimation[J].IEEE Tram.Circuits Syst.Video Technol, 1998,: 369-377.
[35]刘云,孟岩,孙芳. JM模型中UMHexagonS改进算法[J],系统仿真学报,2009,21(1):149-152.
[36]吴杰杰,刘渊.一种八边形的混合快速运动估计算法[J].计算机工程与应用, 2010, 46(5): 181-183.
[37] Hong-ye LI, Ming-jun LIU, Zhi-qiang ZHANG. A New Fast Motion Estimation Algorithm Based on H.264[C]. 2009 International Conference on Multimedia Information Networking and Security, 2009:287-290.
[38]王莉莉,黄晓革,甘涛.一种自适应十字—方形运动估计快速算法[J].计算机应用研究, 2009, 26(2): 540-542.
[39]李丽,宋刚.一种新的基于H.264的快速运动估计算法[J].计算机工程与应用, 2010, 46(7): 136-138.
[40]王跃宗,刘京会. DSP应用系统的设计与开发[M].北京:人民邮电出版社,2009.
[41]杨芳芳. H.264编码器的DSP实现与优化[D].西安:西安电子科技大学,2009.
[42]王克钊. H.264视频压缩编码标准研究与实现[D].西安:西安电子科技大学,2009.
[43]李青华,于峰崎.基于TMS320DM642的X264视频编码器的优化[J].器件与应用, 2010, 34(8): 39-42.
[44]张石,矫田广,刘晓志.基于DSP平台H.264编码器的实现与优化[J].自动化技术, 2008, 19: 126-130.
[2]葛奇.基于DSP的H.264编码器的实现与优化[D].成都:电子科技大学,2009.
[3]余兆明.图像编码标准H.264技术[M].北京:人民邮电出版社,2006.
[4]毕厚杰.新一带视频压缩标准—H.264/AVC[M].第二版.北京:人民邮电出版社,2009.
[5]钟玉琢. MPEG-2运动图像压缩编码国际标准及MPEG的新进展[M].北京:清华大学出版社,2002.
[6]胡振.基于H.264无线视频编码算法的研究与DSP实现[D].扬州:扬州大学,2009.
[7] Joch A,Kossentini F,Nasiopoulos P.A Performance Analysis of the ITU-T Draft H.26L[c].Department of Electrical and Computer Engineering University of British Columbia.2002:1-12.
[8] Iain E.O.Richardson.H.264and MPEG-4 Video Compression[J]. John Wiley &Sons Inc,2003:159-162.
[9]王英坤,徐伯庆,杨华.高效帧内预测模式选择算法[J].计算机应用, 2008, 28: 183-186.
[10] Rui SU, Guizhong LIU,Tongyu ZHANG.Fast mode decision algorithm for intra prediction in H.264/AVC with integer transform and adaptive threshold[C].2006 IEEE International Conference on Acoustics, Speech and Signal Processing. New York:IEEE, 2007, 1: 11-27.
[11] Mohammed Golam Sarwer, Q.M. Jonathan Wu. Adaptive Search Area Selection of Variable Block-Size Motion Estimation ofH.264/AVC Video Coding Standard[C]. 2009 11th IEEE International Symposium on Multimedia, Canada: 2009, 100-105.
[12]楼剑,虞露.新一代的视频编解码标准-H.264[J].当代通信, 2003, 13(5): 27-32.
[13]李可.基于DSP的H.264/AVC编码器的设计与实现[D].北京:北京工业大学,2007.
[14] Itoh Y.Bi-directional Motion Vector Coding Using University VLC[J]. Image Communication, 1999:541-547.
[15] Iain E G Richardson, Context-Based Adaptive Arithmetic Coding (CABAC),H.264/MPEG4 Part 10 White Paper, Mar. 2003.
[16]汪纪锋,彭光辉. H.264/AVC帧内4×4块预测模式选择算法研究[J].重庆邮电大学学报(自然科学版), 2008, 20(5): 499-552.
[17] Feng PAN, Xiao LIN, Rahardja. Fast Mode Decision for Intra Prediction[C]. 7th Meeting: Pattaya II, Thailand: 2003: 201-210.
[18] Zhang JN,He YWj Yang SQ,Zhong YZ.A fast intra prediction method for H.264 video coding[J].SPIE-INT Soc Optical Engineering, 2003, 52(03): 753-761.
[19] Kim C,SH IH H2H,KUO C2CJ.Multistage mode decision for intra prediction in H.264 codec.[C]. 1 6th Annual Symposium Electric Imaging,Califormia: 2004: 321-336.
[20] Cheng CC,Chang TS.Fast three step intra prediction algorithm for 4x4 blocks[A]. IEEE International Symposium on Circuits and Systems, 2005: 1509:1512.
[21] Pan F,Lin X,Rahardja S.A Directional Field Based Fast Intra Mode Decision Algorithm for H.264 Video Coding[C].IEEE International Conference on Multimedia and Expo(ICME 2004),Taibei,Taiwan, 2004, TP l-4: 1147-1150.
[22] Yongdong ZHANG,DaiFeng,Shouxun LIN.fast 4x4 Intra prediction Mode election for H.264[C]. IEEE International Conference on Multimedia and Expo. 2004, 2: l151-1155.
[23] Wang JC,Wang JF,Yang JF,Chen JT.A fast mode decision algorithm and its VISI design for H.264/AVC intra-prediction[J]. IEEE Transactions on Circuits and Systems for Video Technology. 2007, 17(10): 1414-1422.
[24]刘佳,董金明.一种新的H.264/AVC快速帧内预测模式选择判决算法[J].电子与信息学报, 2009, 31(5): 1072-1075.
[25]赵杰. H 264/AVC帧内预测算法优化研究[D].南京:南京邮电大学,2008.
[26] DO QUAN. Fast Intra Prediction Mode Decision For H.264/AVC[J].ICICE Trans.Inf.&Syst, 2010, 7: 2012-2015.
[27] Do Quan, Yo-Sung Ho. Categorization for Fast Intra Prediction Mode Decision IN H.264/AVC[J]. IEEE Transactions on Consumer Electronics, 2010, 56(2): 1049:1055.
[28] Jen-Shiun Chiang, Chih-Hsien Hsia, Tsai-Yuan Teng. Fast Intra Prediction Mode Decision Algorithm for 4×4 Blocks in H.264/ MPEG-4 AVC[J]. Tamkang Journal of Science and Engineering, 2008, 11(1): 49-54.
[29]曾焕强,蔡灿辉. H.264/AVC快速帧内预测模式选择算法[C].第十三届全嗣图象图形学学术会议,南京: 130-133.
[30]江根.基于H.264的运动估计算法的研究与优化[D].武汉:武汉理工大学,2009.
[31]侯文博.基于H.264的运动估计算法研究[D].哈尔滨:哈尔滨工程大学,2009.
[32] Koga T,linuma K , Hirano A et a1.Motion-compensated inter frame coding for video conferencing[J].Proc NTC81,New.Orleans,LA. 1981,11, C9.6.1-9.6.5.
[33] R Li,B Zeng,M L Liou.A new three-step search algorithm for block motion estimation[J].IEEE Transactions on Circuits and Systems for Video Technology, 1994, 4(4): 438-442.
[34] J.Y Tham,S.Ranganath,M.Ranganath,et a1.A novel unrestricted center-biased diamond search algorithm for block motion estimation[J].IEEE Tram.Circuits Syst.Video Technol, 1998,: 369-377.
[35]刘云,孟岩,孙芳. JM模型中UMHexagonS改进算法[J],系统仿真学报,2009,21(1):149-152.
[36]吴杰杰,刘渊.一种八边形的混合快速运动估计算法[J].计算机工程与应用, 2010, 46(5): 181-183.
[37] Hong-ye LI, Ming-jun LIU, Zhi-qiang ZHANG. A New Fast Motion Estimation Algorithm Based on H.264[C]. 2009 International Conference on Multimedia Information Networking and Security, 2009:287-290.
[38]王莉莉,黄晓革,甘涛.一种自适应十字—方形运动估计快速算法[J].计算机应用研究, 2009, 26(2): 540-542.
[39]李丽,宋刚.一种新的基于H.264的快速运动估计算法[J].计算机工程与应用, 2010, 46(7): 136-138.
[40]王跃宗,刘京会. DSP应用系统的设计与开发[M].北京:人民邮电出版社,2009.
[41]杨芳芳. H.264编码器的DSP实现与优化[D].西安:西安电子科技大学,2009.
[42]王克钊. H.264视频压缩编码标准研究与实现[D].西安:西安电子科技大学,2009.
[43]李青华,于峰崎.基于TMS320DM642的X264视频编码器的优化[J].器件与应用, 2010, 34(8): 39-42.
[44]张石,矫田广,刘晓志.基于DSP平台H.264编码器的实现与优化[J].自动化技术, 2008, 19: 126-130.