基于H.264的视频压缩算法在DM642上的实现
摘要
H.264/AVC规范是由国际电联(ITU-T)和国际标准化组织(ISO)联合制定的新一代视频编解码标准。它具有如下四个特点:低码流,和MPEG2等压缩技术相比,在同等图像质量下,采用H.264技术压缩后的数据量只有MPEG2的1/8;高图象质量,复杂的算法保证了低码流条件下图像仍能保留丰富的细节;容错能力强,提供了解决在不稳定网络环境下容易发生的丢包等错误的必要工具;网络适应性强,提供了网络适应层,数据能在不同网络上传输。但由此带来的代价是复杂度极高的编码过程,尤其是在嵌入式系统中实现具有很大的挑战性。
本文主要介绍了基于H.264标准的开源代码T264向DM642平台的移植和优化。优化综合运用了上层和底层的实现方法实现。上层的方法例如使用CCS提供的条件优化代码优化功能,使用IMGLIB中高度优化的函数等,其特点是简便易行,效果良好;底层的实现方法例如使用DM642特有的内联函数,用线性汇编的方式实现算法等,特点是提高了代码运行的并行性,但需要对DM642和H.264有很深刻的理解。
目前本设计已成功完成H.264算法在DM642开发板上的运行,压缩QCIF格式视频的速度随图像复杂度的不同达到了35～50帧每秒。此后本设计还继续使用优化后的编码器实现了监控用视频服务器的原型,使得摄像头采集的视频数据在DM642开发板上压缩后传输至PC机,且能够在PC端用配套的程序成功解码并播放。
The H.264/AVC standard is a new generation video compression standard founded by ITU-T and ISO. There are four advantages with H.264. Firstly, it has a low bit-rate in comparison with MPEG2 compression technology. With the same quality, the data size generated by H.264/AVC is 1/8 less than that of MPEG2 code. Secondly, its highly sophisticated algorithms ensure rich details reserved even at the low bit-rates condition. Thirdly, it is highly fault tolerant, providing necessary tools to solve packet-loss and other errors caused by instability network Fourthly, it has network adaptive layer, making it more suitable for data transmission across different networks. The codec and the algorithms adopted in the implementation, however, are highly sophisticated.
The main task of this paper is to introduce how to transfer and optimize the T264 encoder to DM642 platform. There are two levels to optimize the codec. The way of higher level use the conditional optimization provided by CCS and efficient function in IMGLIB, it is simple and effective; The way of lower level use intrinsics and linear assembly language, it improve the parallelism inherent in the H.264 encoder, but need deep understanding about DM642 and H.264.
Our H.264 encoder can encode 35～50 frames per second for QCIF resolution video. And this encoder is used as a video server, it capture video from camera and send it to PC after code the image in DM642, At last a PC software will decode the data and display the video on screen.
本文主要介绍了基于H.264标准的开源代码T264向DM642平台的移植和优化。优化综合运用了上层和底层的实现方法实现。上层的方法例如使用CCS提供的条件优化代码优化功能,使用IMGLIB中高度优化的函数等,其特点是简便易行,效果良好;底层的实现方法例如使用DM642特有的内联函数,用线性汇编的方式实现算法等,特点是提高了代码运行的并行性,但需要对DM642和H.264有很深刻的理解。
目前本设计已成功完成H.264算法在DM642开发板上的运行,压缩QCIF格式视频的速度随图像复杂度的不同达到了35～50帧每秒。此后本设计还继续使用优化后的编码器实现了监控用视频服务器的原型,使得摄像头采集的视频数据在DM642开发板上压缩后传输至PC机,且能够在PC端用配套的程序成功解码并播放。
The H.264/AVC standard is a new generation video compression standard founded by ITU-T and ISO. There are four advantages with H.264. Firstly, it has a low bit-rate in comparison with MPEG2 compression technology. With the same quality, the data size generated by H.264/AVC is 1/8 less than that of MPEG2 code. Secondly, its highly sophisticated algorithms ensure rich details reserved even at the low bit-rates condition. Thirdly, it is highly fault tolerant, providing necessary tools to solve packet-loss and other errors caused by instability network Fourthly, it has network adaptive layer, making it more suitable for data transmission across different networks. The codec and the algorithms adopted in the implementation, however, are highly sophisticated.
The main task of this paper is to introduce how to transfer and optimize the T264 encoder to DM642 platform. There are two levels to optimize the codec. The way of higher level use the conditional optimization provided by CCS and efficient function in IMGLIB, it is simple and effective; The way of lower level use intrinsics and linear assembly language, it improve the parallelism inherent in the H.264 encoder, but need deep understanding about DM642 and H.264.
Our H.264 encoder can encode 35～50 frames per second for QCIF resolution video. And this encoder is used as a video server, it capture video from camera and send it to PC after code the image in DM642, At last a PC software will decode the data and display the video on screen.
引文
[1]T.Wedi.Motion Compensation in H.264/AVC.IEEE Transactions on Circuits and Systems For Video Technology,2003,13(7)
[2]周勇,邓中亮.H.264视频编码技术研究与应用.北京邮电大学自动化学院,2004.91-94
[3]Kantarci A,Yolum P,Gungor T.Implementation of a video streaming system using scalable extension of H.264.Computer and information Sciences-ISCIS.20th International Symposium,2005
[4]毕厚杰.新一代视频压缩编码标准--H.264/AVC.北京:人民邮电出版社,2005.84-148
[5]Stamoulis G,Koziri M,Katsavounidis.Low-power VLSI architecture for intra prediction in H.264.10th Panhellenic Conference on Informatics,PC12005,Proceedings,2005
[6]张益贞,刘滔,Visual C++实现MPEG/JPEG编解码技术北京:人民邮电出版社,2004.22-23
[7]H.Schwarz,D.Marpe,T.Wiegand.CABAC and slices.JVT document JVT-D020,Klagenfurt,2002
[8]D.Marpe,H.Schwarz,T.Wiegand.Context-based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard.IEEE Trans.Circuits Syst.Video Technol,2003,13:620-634
[9]Gary J.Sullivan,Thomas Wiegand.Rate Distortion Optimization for Video Compression.IEEE Signal Processing Magazine,1998.74-90
[10]Thomas Wiegand,Bemd Girod.Lagrange Multiplier Selection in Hybrid Video Coder Control.Proc.ICIP,2001.542-545
[11]Ma S,Gao W,Lu Y.lmproved Rate Control Algorithm.JVT-F086.6th JVT Meeting,2002.4-15
[12]Texas Instruments Incorporated.DSP Selection Guide,2006
[13]Texas Instruments Incorporated.TMS320C64x Technical Overview,2001(1)
[14]李方慧,王飞.TMS320C6000系列DSPs的原理与应用.北京:电子工业出版社,2005
[15]SPRS200B.TMS320DM642 Video/Imaging Fixed-Point Digital signal Processor.Texas Instruments Incorporated,2003
[16]Texas Instruments Incorporated.TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor,2002
[17]Texas Instruments Incorporated.TMS320C6000 CPU and Instruction Set Reference Guide,2000
[18]Texas Instruments Incorporated.TMS320C6000 Technical Brief,1999
[19]Texas Instruments Incorporated.TMS320C64x DSP Two-Level Internal Memory Reference Guide,2006
[20]Texas Instruments.DSP/BOIS Sizing Guidelines on TMS320C6000 DSP for Code Composer Studio 2.0,2001
[21]Texas Instruments.TMS320C6000 DSP/BOIS Application Programming Interface (API)Reference Guide,2001
[221 彭启琮,管庆等.DSP集成开发坏境--CCS及DSP/IOS的原理与应用.匕京:电子工业出版社,2004
[23]张彤宇,苏睿.H.264/AVC视频编码器在DM642平台上的实现与优化.微电子学与计算机,2005,22(12):165-168
[24]王嵩.H.264/AVC视频编码标准研究及其编码器的优化.浙江大学,2004
[25]王喜微,唐昆,崔慧娟.基于DM642的视频编码Cache优化策略.微计算机信息,2005,21(9-2)
[26]刘包兰,刘贵忠.H.264中整数DCT变换及量化的DSP实现.微电子学与计算机,2005,22(6):200-205
[27]李杰,蔡灿辉.H.264算法在TI C64X上的移植及优化.计算机工程与应用,2005
[28]吴乐南.数据压缩.北京:电子工业出版社,2000
[29]周祥平,王嵩.新标准H.264的核心技术与应用前景.中国有线电视,2004
[30]张涛,沈斌.从H.261到H.264看视频编码标准的进展.数字电视与数字视频,2003
[31]闫冬.H.264/AVC编码器的优化设计与实现.电子科技大学.2004
[32]马小虎,张明敏,严华明.多媒体数据压缩标准及实现.清华大学出版社,1996
[33]张芙蓉.DM642监控视频H.264编码器的实现和优化.浙江大学,2006
[34]余松意,周源华,吴时光.数字图像处理。电子工业出版社,1989
[35]徐华根.视频编码算法研究及其在DM642上的实现.浙江大学,2005
[36]Atual Puria,Xuemin Chenb,Ajay Luthra.Video Coding using the H.264/MPEG-4AVC Compression Standard.Signal Processing,Image Communication,19(2004): 793-849
[37]Iain E.G.Richardson.H.264 and MPEG-4 video compression.The Robert Gordon University,Aberdeen,UK,2004
[38]Stephan Wenger.H.264/AVC Over IP.IEEE Trans.Circuits Syst.Video Technol,2003,13171:645-656
[39]Texas Instruments.TMS320C6000 DSP Enhanced Direct Memory Access Controller Reference Guide,2005
[40]TI.TMS320C6000 C/C++ Optimizing Compiler User's Guide,2002
[41]TI.Image Processing Example Using the TMS320C64x Image/Video Processing Library,2003
[42]郭兵.H.264算法研究及DSP实现.重庆大学,2005
[43]余兆明,查日勇.图像编码标准H.264技术.北京:人民邮电出版社,2006
[44]赵立新.H.264视频压缩技术的研究.辽宁工程技术大学,2004
[45]秦岭.视频编码标准H.264的主要技术亮点及其应用前景.计算机应用,2004,25(4):449-455
[46]许小冬,徐佩霞.基于TMS320DM642的视频编码系统优化.数据采集与处理,2005,20(1):91-95
[47]何艳辉,朱珍明.H.264视频编码技术研究.湖南大学学报,2003,30(3),196-199
[48]赵红怡.DSP技术与应用实例.电子工业出版社,2003
[49]钱瑛.H.264视频编解技术研究及其在TI-DSP DM642上的实现.南京理工大学,2006
[50]江思敏,刘畅.TMS320C6000 DSP应用开发教程.机械工业出版社,2005
[2]周勇,邓中亮.H.264视频编码技术研究与应用.北京邮电大学自动化学院,2004.91-94
[3]Kantarci A,Yolum P,Gungor T.Implementation of a video streaming system using scalable extension of H.264.Computer and information Sciences-ISCIS.20th International Symposium,2005
[4]毕厚杰.新一代视频压缩编码标准--H.264/AVC.北京:人民邮电出版社,2005.84-148
[5]Stamoulis G,Koziri M,Katsavounidis.Low-power VLSI architecture for intra prediction in H.264.10th Panhellenic Conference on Informatics,PC12005,Proceedings,2005
[6]张益贞,刘滔,Visual C++实现MPEG/JPEG编解码技术北京:人民邮电出版社,2004.22-23
[7]H.Schwarz,D.Marpe,T.Wiegand.CABAC and slices.JVT document JVT-D020,Klagenfurt,2002
[8]D.Marpe,H.Schwarz,T.Wiegand.Context-based Adaptive Binary Arithmetic Coding in the H.264/AVC Video Compression Standard.IEEE Trans.Circuits Syst.Video Technol,2003,13:620-634
[9]Gary J.Sullivan,Thomas Wiegand.Rate Distortion Optimization for Video Compression.IEEE Signal Processing Magazine,1998.74-90
[10]Thomas Wiegand,Bemd Girod.Lagrange Multiplier Selection in Hybrid Video Coder Control.Proc.ICIP,2001.542-545
[11]Ma S,Gao W,Lu Y.lmproved Rate Control Algorithm.JVT-F086.6th JVT Meeting,2002.4-15
[12]Texas Instruments Incorporated.DSP Selection Guide,2006
[13]Texas Instruments Incorporated.TMS320C64x Technical Overview,2001(1)
[14]李方慧,王飞.TMS320C6000系列DSPs的原理与应用.北京:电子工业出版社,2005
[15]SPRS200B.TMS320DM642 Video/Imaging Fixed-Point Digital signal Processor.Texas Instruments Incorporated,2003
[16]Texas Instruments Incorporated.TMS320DM642 Video/Imaging Fixed-Point Digital Signal Processor,2002
[17]Texas Instruments Incorporated.TMS320C6000 CPU and Instruction Set Reference Guide,2000
[18]Texas Instruments Incorporated.TMS320C6000 Technical Brief,1999
[19]Texas Instruments Incorporated.TMS320C64x DSP Two-Level Internal Memory Reference Guide,2006
[20]Texas Instruments.DSP/BOIS Sizing Guidelines on TMS320C6000 DSP for Code Composer Studio 2.0,2001
[21]Texas Instruments.TMS320C6000 DSP/BOIS Application Programming Interface (API)Reference Guide,2001
[221 彭启琮,管庆等.DSP集成开发坏境--CCS及DSP/IOS的原理与应用.匕京:电子工业出版社,2004
[23]张彤宇,苏睿.H.264/AVC视频编码器在DM642平台上的实现与优化.微电子学与计算机,2005,22(12):165-168
[24]王嵩.H.264/AVC视频编码标准研究及其编码器的优化.浙江大学,2004
[25]王喜微,唐昆,崔慧娟.基于DM642的视频编码Cache优化策略.微计算机信息,2005,21(9-2)
[26]刘包兰,刘贵忠.H.264中整数DCT变换及量化的DSP实现.微电子学与计算机,2005,22(6):200-205
[27]李杰,蔡灿辉.H.264算法在TI C64X上的移植及优化.计算机工程与应用,2005
[28]吴乐南.数据压缩.北京:电子工业出版社,2000
[29]周祥平,王嵩.新标准H.264的核心技术与应用前景.中国有线电视,2004
[30]张涛,沈斌.从H.261到H.264看视频编码标准的进展.数字电视与数字视频,2003
[31]闫冬.H.264/AVC编码器的优化设计与实现.电子科技大学.2004
[32]马小虎,张明敏,严华明.多媒体数据压缩标准及实现.清华大学出版社,1996
[33]张芙蓉.DM642监控视频H.264编码器的实现和优化.浙江大学,2006
[34]余松意,周源华,吴时光.数字图像处理。电子工业出版社,1989
[35]徐华根.视频编码算法研究及其在DM642上的实现.浙江大学,2005
[36]Atual Puria,Xuemin Chenb,Ajay Luthra.Video Coding using the H.264/MPEG-4AVC Compression Standard.Signal Processing,Image Communication,19(2004): 793-849
[37]Iain E.G.Richardson.H.264 and MPEG-4 video compression.The Robert Gordon University,Aberdeen,UK,2004
[38]Stephan Wenger.H.264/AVC Over IP.IEEE Trans.Circuits Syst.Video Technol,2003,13171:645-656
[39]Texas Instruments.TMS320C6000 DSP Enhanced Direct Memory Access Controller Reference Guide,2005
[40]TI.TMS320C6000 C/C++ Optimizing Compiler User's Guide,2002
[41]TI.Image Processing Example Using the TMS320C64x Image/Video Processing Library,2003
[42]郭兵.H.264算法研究及DSP实现.重庆大学,2005
[43]余兆明,查日勇.图像编码标准H.264技术.北京:人民邮电出版社,2006
[44]赵立新.H.264视频压缩技术的研究.辽宁工程技术大学,2004
[45]秦岭.视频编码标准H.264的主要技术亮点及其应用前景.计算机应用,2004,25(4):449-455
[46]许小冬,徐佩霞.基于TMS320DM642的视频编码系统优化.数据采集与处理,2005,20(1):91-95
[47]何艳辉,朱珍明.H.264视频编码技术研究.湖南大学学报,2003,30(3),196-199
[48]赵红怡.DSP技术与应用实例.电子工业出版社,2003
[49]钱瑛.H.264视频编解技术研究及其在TI-DSP DM642上的实现.南京理工大学,2006
[50]江思敏,刘畅.TMS320C6000 DSP应用开发教程.机械工业出版社,2005