H.264视频编码器在ADSP-BF561上的实现及优化
|
摘要
视频监控以其方便、信息内容丰富而广泛应用于安保、生产管理等场合。图像编解码技术是视频监控中的关键技术之一。
新一代视频编解码标准H.264压缩性能好，但计算复杂度高，限制了H.264标准的应用。Blackfin处理器是ADI公司推出的低功耗、高性能的定点DSP芯片，是H.264标准DSP实现的理想平台。
本论文的研究目的是针对视频监控的需要，研究、实现一套基于H.264标准的视频编码系统。探讨H.264软件编码器在BF561上的实现及优化方法。
论文主要是H.264和BF561嵌入式系统的应用研究。介绍了H.264标准的基本思想和原理及BF561的开发基础。分析了X264编码器流程，确定软件编码方案。实现了基于uCLinux嵌入式操作系统的X264编码器移植。最后，以ADSP-BF561 EZ-KIT LITE评估板为编码系统，使用各种优化方法和技巧，完成X264编码器的优化。
根据BF561的结构特点，论文从项目级和C语言级别初步优化编码器；并着重用汇编优化了H.264的耗时模块，SAD运算、SATD运算和整数DCT变换程序；根据BF561的高速缓存机制，启用CACHE，提高系统编码速度。最后，用不同的测试序列对各阶段优化效果进行测试，确定较优的基于BF561的H.264视频编码器优化方案。
本论文设计的软件编码系统具有较高的编码效率，测试结果表明了系统的可行性和稳定性。因此，研究基于BF561的H.264视频编码器具有一定的实用价值。
Because of the richness and convenience, video monitoring is used widely by safety guard, product management, and so on. The video codec technology is the key in video monitoring.
As the latest video codec standard, H.264 has the advantage of high compression rate. But because of its complex calculation, the application of this standard is limited. Blackifin processor is the pointing device produced by ADI Company, with low-powered consumption and high-powered performance. It is the perfect DSP flat in realizing the H.264 standard.
The aim of the paper is to meet the need of video monitoring, research and realize a video encoder system based on H.264 standard, and discuss the realizing of H.264 Video Encoder based on BF561 and how to improve the encoding efficiency.
The paper is mainly in the application of H.264 and the embedded system based on BF561. First, the author introduces the basic thought and theory of H.264, and the developing theories of BF561. Second, the author analyzes the flow of X264, and decides the software encodeing scheme. Third, the author realizes the migration of X264 Encoder based on uCLinux embedded operation system. Finally, the ADSP-BF561 EZ-KIT LITE evaluation board is employed as the video coding system. By various methords and skills, the author completes the optimization of X264.
According to the characteristic of BF561, first of all, optimize the encoder in project and C language programming primarily. Secondly, optimize the time-consuming module, SAD arithmetic, SATD arithmetic, and DCT transform in assemble language. Thirdly, make use of the mechanism of Cache of the BF561 in order to improve the encoding rate. At last, test the effect of optimizing in every phases by several test sequences, and ascertain the better H.264 Video Encoder optimizing scheme based on BF561.
The software encoding system designed in this paper has higher compress ratio. The test results indicates that the system's feasibility and stability. Therefore, researching the H.264 Video Encoder based on BF561 has a certain practical value.
新一代视频编解码标准H.264压缩性能好，但计算复杂度高，限制了H.264标准的应用。Blackfin处理器是ADI公司推出的低功耗、高性能的定点DSP芯片，是H.264标准DSP实现的理想平台。
本论文的研究目的是针对视频监控的需要，研究、实现一套基于H.264标准的视频编码系统。探讨H.264软件编码器在BF561上的实现及优化方法。
论文主要是H.264和BF561嵌入式系统的应用研究。介绍了H.264标准的基本思想和原理及BF561的开发基础。分析了X264编码器流程，确定软件编码方案。实现了基于uCLinux嵌入式操作系统的X264编码器移植。最后，以ADSP-BF561 EZ-KIT LITE评估板为编码系统，使用各种优化方法和技巧，完成X264编码器的优化。
根据BF561的结构特点，论文从项目级和C语言级别初步优化编码器；并着重用汇编优化了H.264的耗时模块，SAD运算、SATD运算和整数DCT变换程序；根据BF561的高速缓存机制，启用CACHE，提高系统编码速度。最后，用不同的测试序列对各阶段优化效果进行测试，确定较优的基于BF561的H.264视频编码器优化方案。
本论文设计的软件编码系统具有较高的编码效率，测试结果表明了系统的可行性和稳定性。因此，研究基于BF561的H.264视频编码器具有一定的实用价值。
Because of the richness and convenience, video monitoring is used widely by safety guard, product management, and so on. The video codec technology is the key in video monitoring.
As the latest video codec standard, H.264 has the advantage of high compression rate. But because of its complex calculation, the application of this standard is limited. Blackifin processor is the pointing device produced by ADI Company, with low-powered consumption and high-powered performance. It is the perfect DSP flat in realizing the H.264 standard.
The aim of the paper is to meet the need of video monitoring, research and realize a video encoder system based on H.264 standard, and discuss the realizing of H.264 Video Encoder based on BF561 and how to improve the encoding efficiency.
The paper is mainly in the application of H.264 and the embedded system based on BF561. First, the author introduces the basic thought and theory of H.264, and the developing theories of BF561. Second, the author analyzes the flow of X264, and decides the software encodeing scheme. Third, the author realizes the migration of X264 Encoder based on uCLinux embedded operation system. Finally, the ADSP-BF561 EZ-KIT LITE evaluation board is employed as the video coding system. By various methords and skills, the author completes the optimization of X264.
According to the characteristic of BF561, first of all, optimize the encoder in project and C language programming primarily. Secondly, optimize the time-consuming module, SAD arithmetic, SATD arithmetic, and DCT transform in assemble language. Thirdly, make use of the mechanism of Cache of the BF561 in order to improve the encoding rate. At last, test the effect of optimizing in every phases by several test sequences, and ascertain the better H.264 Video Encoder optimizing scheme based on BF561.
The software encoding system designed in this paper has higher compress ratio. The test results indicates that the system's feasibility and stability. Therefore, researching the H.264 Video Encoder based on BF561 has a certain practical value.
引文
[1] 毕厚杰．新一代视频压缩编码标准——H.264．北京：人民邮电出版社，2005
[2] 刘峰．视频图像编码技术及国际标准．北京：北京邮电大学出版社，2005
[3] 余兆明．图像编码标准H.264技术．北京：人民邮电出版社，2006
[4] 理查森，欧阳合，韩军．H.264和MPEG-4视频压缩．长沙：国防科技大学出版社，2004
[5] 胡国荣．数字视频压缩及其标准．北京：北京广播学院出版社，1999
[6] 钟玉琢，王琪，贺玉文．基于对象的多媒体数据压缩编码国际标准MPEG-4及其校验模型．北京：科学出版社，2000
[7] RichardsonIain E.G，欧阳合，韩军．视频编解码器设计——开发图像与视频压缩系统．长沙：国防科技大学出版社，2005
[8] 李玉山．数字视觉视频技术．西安：西安电子科技大学出版社，2006
[9] 黎洪松．数字视频技术及其应用．北京：清华大学出版社，1997．5
[10] 全子一．数字视频图像处理．北京：电子工业出版社，2005
[11] 刘富强，王新红．数字视频信息处理与传输教程．北京：机械工业出版社，2004
[12] H. 264 and MPEG-4 Video Compression-Video Coding for Next-generation Multimedia[M]. Iain E.G. Richardson. The Robert Gordon University, Aberdeen, UK, 2003, 159-222
[13] Overview of the H.264 Video Coding Standard[M], Thomas Wiegand, Gary J. Sullivan, Gisle Bjrontegaard, Ajay Luthra. TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003, 560-575
[14] Stephan Wenger. H.264/AVC Over IP. IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 645～656, July 2003
[15] Y.Wang and Q. Zhu. Error control and concealment for video communication: a review. Proceedings of the IEEE, vol. 86, pp. 974～997. May 1998
[16] J. Wen and J. Villasenor. A class of reversible variable length codes for robust image and video coding. Pro. 1997 IEEE International Conf. On Image Proc., Santa Barbara, CA Oct. 1997
[17] J. Wen and J. Villasenor. Reversible variable length codes for robust image and video transmission. 1997 Asilomar Conference, Pacific Grove, CA, Nov. 1997
[18] Q.F. Zhu, Y.Wang, and L. Shaw. Coding and cell loss recovery for DCT-based packet video. IEEE Trans. CAS for Video Tech., vol. 3, no. 3, pp. 248～258, June 1993
[19] 刘富强．数字视频监控系统开发及应用．北京：机械工业出版社，2003
[20] 陈峰．Blackfin系列DSP原理与系统设计．北京：电子工业出版社，2004
[21] 王田苗．嵌入式系统设计与实例开发——基于ARM微处理器与uC／OS-Ⅱ实时操作系统．北京：清华大学出版社，2002
[22] 李驹光．ARM应用系统开发详解——基于S3C4510B的系统设计．北京：清华大学出版社，2004
[23] 马忠梅，马广云，徐英慧，田泽．ARM嵌入式处理器结构与应用基础．北京：航空航天大学出版社，2002
[24] 桑楠．嵌入式系统原理及应用开发技术．北京：北京航空航天大学出版社，2002
[25] 刘峥嵘，张智超，许振山．嵌入式Linux应用开发详解．北京：机械工业出版社，2005
[26] 郑红．DSP应用系统设计实践．北京：北京航空航天大学出版社，2006
[27] 李岩，荣盘祥．基于S3C44BOX嵌入式uCLinux系统原理及应用．北京：清华大学出版社，2005
[28] 森林图书工作室．Linux & Unix C程序员参考大全．北京：国防工业出版社，2001
[29] 张雄伟．DSP集成开发与应用实例．北京：电子工业出版社，2002
[30] 陈意云，张昱．编译原理．北京：高等教育出版社，2003
[31] Molay, Bruce. Unix/Linux编程实践教程．杨宗源，黄海涛译．北京：清华大学出版社，2004
[32] long ba duoJ, LombardoJohn．嵌入式Linux=Embedded Linux．吴雨浓译．北京：中国电力出版社，2003
[33] qiang senM. K., JohnsonMichael K., TroanErik W. Linux编程权威指南=Linux application．龙华乔，胡以迳译．北京：中国电力出版社， 2001
[34] AlexanderRene，BensleyGraham．C++高效编程=C++ footprint and performance optimization：内存与性能优化．王峰．史金虎译．北京：中国电力出版社，2003
[35] 卡斯佩尔斯基．代码优化：有效使用内存．谭明金译．北京：电子工业出版社，2004
[36] 王颖，陈乃海．H.264视频编码器基本档次的实现方案[J]．记录媒体技术．2006，7(4)：39-41
[37] 范学海，胡佼，金炜东．基于G07007SB的嵌入式MPEG-4远程视频监控系统[J]．黑龙江科技学院学报．2005，2(15)：126-128
[38] 苏辉，孔德佳，余松煜．基于ADSP-BF533的实时图像编码关键技术[J]．计算机工程与应用．2005，4：88-90
[39] 罗龙智，黄晓革，甘涛．定点ADSP-Blackfin533的混合编程技术[J]．电声技术．2006，1：33-35
[40] 闫健恩，许海燕，林建秋．基于ADSP-Blackfin533的H.264视频编码器的实现[J]．微计算机信息．2006，(22)：27-29
[41] 于培松．基于BLACKFIN533的H.264视频编码研究[D]．西安：西安电子科技大学，2005，1
[42] 王嵩．H.264视频编码标准研究及其编码器的优化[D]．杭州：浙江大学，2004，2
[43] 闫冬．H.264编码器的优化设计及实现[D]．成都：电子科技大学，2004，3
[44] Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H. 264/ISO/IEC 14496-10 Arc) [S], 7th Meeting, Pattaya, Thailand, 7-14 March, 2003, 77-146
[45] H. 264/MPEG-4 AVC Reference Software Manual. Alexis Michael Tourapis, Karsten Suhring, Gary Sullivan. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q. 6) 14th Meeting, Hong Kong, PRC China 17-21 Jan. , 2005
[46] ITU-T Draft for "H. 263++" Annexes U, V, and W to Recommendation H. 263, Nov. 2000
[47] ISO/IEC IS 14496-2. Information Technology—Generic coding of audio-visual objects. Part2: Visual. Nov. 1998
[48] Analog Devices,Inc.Visual DSP++4.0 C/C++ Compiler and Library Manual for Blackfin Processors. http://www.analog.com/processors/resources/technicalLibrary/manuals,2005.1
[49] Analog Devices,Inc.Visual DSP++4.0 Assembler and Preprocessor Manual. http://www.analog.com/processors/resources/technicalLibrary/manuals,2005.1
[50] Analog Devices,Inc.Visual DSP++4.0 Linker and Utilities Manual. http://www.analog.com/processors/resources/technicalLibrary/manuals,2005.1
[51] Analog Devices, Inc. Blackfin Processor Instruction Set Reference. http://www.analog.com/processors/resources/technicalLibrary/manuals,2004.6
[52] Analog Devices,Inc.ADSP-BF561 Blackfin Processors Hardware Reference. http://www. analog. com/industry/dsp/tech_doc/gen_purpose.html, 2003. 11
[53] Iain E G Richardson.H.264/MPEG-4 Part 10 White Paper. http://www.vcodex.com,2002
[54] Intel Corporation, "Software Optimization Cookbook".
[55] 嵌入式操作系统一览. http://www. gkong.com/learn/
[56] μClinux官方网站. http://www.uCLinux.org/
[57] Linux论坛.. http://www.linuxforum. net/
[58] C程序优化. http://creativesoft.home.shangdu.net
[2] 刘峰．视频图像编码技术及国际标准．北京：北京邮电大学出版社，2005
[3] 余兆明．图像编码标准H.264技术．北京：人民邮电出版社，2006
[4] 理查森，欧阳合，韩军．H.264和MPEG-4视频压缩．长沙：国防科技大学出版社，2004
[5] 胡国荣．数字视频压缩及其标准．北京：北京广播学院出版社，1999
[6] 钟玉琢，王琪，贺玉文．基于对象的多媒体数据压缩编码国际标准MPEG-4及其校验模型．北京：科学出版社，2000
[7] RichardsonIain E.G，欧阳合，韩军．视频编解码器设计——开发图像与视频压缩系统．长沙：国防科技大学出版社，2005
[8] 李玉山．数字视觉视频技术．西安：西安电子科技大学出版社，2006
[9] 黎洪松．数字视频技术及其应用．北京：清华大学出版社，1997．5
[10] 全子一．数字视频图像处理．北京：电子工业出版社，2005
[11] 刘富强，王新红．数字视频信息处理与传输教程．北京：机械工业出版社，2004
[12] H. 264 and MPEG-4 Video Compression-Video Coding for Next-generation Multimedia[M]. Iain E.G. Richardson. The Robert Gordon University, Aberdeen, UK, 2003, 159-222
[13] Overview of the H.264 Video Coding Standard[M], Thomas Wiegand, Gary J. Sullivan, Gisle Bjrontegaard, Ajay Luthra. TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 13, NO. 7, JULY 2003, 560-575
[14] Stephan Wenger. H.264/AVC Over IP. IEEE Trans. Circuits Syst. Video Technol., vol. 13, pp. 645～656, July 2003
[15] Y.Wang and Q. Zhu. Error control and concealment for video communication: a review. Proceedings of the IEEE, vol. 86, pp. 974～997. May 1998
[16] J. Wen and J. Villasenor. A class of reversible variable length codes for robust image and video coding. Pro. 1997 IEEE International Conf. On Image Proc., Santa Barbara, CA Oct. 1997
[17] J. Wen and J. Villasenor. Reversible variable length codes for robust image and video transmission. 1997 Asilomar Conference, Pacific Grove, CA, Nov. 1997
[18] Q.F. Zhu, Y.Wang, and L. Shaw. Coding and cell loss recovery for DCT-based packet video. IEEE Trans. CAS for Video Tech., vol. 3, no. 3, pp. 248～258, June 1993
[19] 刘富强．数字视频监控系统开发及应用．北京：机械工业出版社，2003
[20] 陈峰．Blackfin系列DSP原理与系统设计．北京：电子工业出版社，2004
[21] 王田苗．嵌入式系统设计与实例开发——基于ARM微处理器与uC／OS-Ⅱ实时操作系统．北京：清华大学出版社，2002
[22] 李驹光．ARM应用系统开发详解——基于S3C4510B的系统设计．北京：清华大学出版社，2004
[23] 马忠梅，马广云，徐英慧，田泽．ARM嵌入式处理器结构与应用基础．北京：航空航天大学出版社，2002
[24] 桑楠．嵌入式系统原理及应用开发技术．北京：北京航空航天大学出版社，2002
[25] 刘峥嵘，张智超，许振山．嵌入式Linux应用开发详解．北京：机械工业出版社，2005
[26] 郑红．DSP应用系统设计实践．北京：北京航空航天大学出版社，2006
[27] 李岩，荣盘祥．基于S3C44BOX嵌入式uCLinux系统原理及应用．北京：清华大学出版社，2005
[28] 森林图书工作室．Linux & Unix C程序员参考大全．北京：国防工业出版社，2001
[29] 张雄伟．DSP集成开发与应用实例．北京：电子工业出版社，2002
[30] 陈意云，张昱．编译原理．北京：高等教育出版社，2003
[31] Molay, Bruce. Unix/Linux编程实践教程．杨宗源，黄海涛译．北京：清华大学出版社，2004
[32] long ba duoJ, LombardoJohn．嵌入式Linux=Embedded Linux．吴雨浓译．北京：中国电力出版社，2003
[33] qiang senM. K., JohnsonMichael K., TroanErik W. Linux编程权威指南=Linux application．龙华乔，胡以迳译．北京：中国电力出版社， 2001
[34] AlexanderRene，BensleyGraham．C++高效编程=C++ footprint and performance optimization：内存与性能优化．王峰．史金虎译．北京：中国电力出版社，2003
[35] 卡斯佩尔斯基．代码优化：有效使用内存．谭明金译．北京：电子工业出版社，2004
[36] 王颖，陈乃海．H.264视频编码器基本档次的实现方案[J]．记录媒体技术．2006，7(4)：39-41
[37] 范学海，胡佼，金炜东．基于G07007SB的嵌入式MPEG-4远程视频监控系统[J]．黑龙江科技学院学报．2005，2(15)：126-128
[38] 苏辉，孔德佳，余松煜．基于ADSP-BF533的实时图像编码关键技术[J]．计算机工程与应用．2005，4：88-90
[39] 罗龙智，黄晓革，甘涛．定点ADSP-Blackfin533的混合编程技术[J]．电声技术．2006，1：33-35
[40] 闫健恩，许海燕，林建秋．基于ADSP-Blackfin533的H.264视频编码器的实现[J]．微计算机信息．2006，(22)：27-29
[41] 于培松．基于BLACKFIN533的H.264视频编码研究[D]．西安：西安电子科技大学，2005，1
[42] 王嵩．H.264视频编码标准研究及其编码器的优化[D]．杭州：浙江大学，2004，2
[43] 闫冬．H.264编码器的优化设计及实现[D]．成都：电子科技大学，2004，3
[44] Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITU-T Rec. H. 264/ISO/IEC 14496-10 Arc) [S], 7th Meeting, Pattaya, Thailand, 7-14 March, 2003, 77-146
[45] H. 264/MPEG-4 AVC Reference Software Manual. Alexis Michael Tourapis, Karsten Suhring, Gary Sullivan. Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q. 6) 14th Meeting, Hong Kong, PRC China 17-21 Jan. , 2005
[46] ITU-T Draft for "H. 263++" Annexes U, V, and W to Recommendation H. 263, Nov. 2000
[47] ISO/IEC IS 14496-2. Information Technology—Generic coding of audio-visual objects. Part2: Visual. Nov. 1998
[48] Analog Devices,Inc.Visual DSP++4.0 C/C++ Compiler and Library Manual for Blackfin Processors. http://www.analog.com/processors/resources/technicalLibrary/manuals,2005.1
[49] Analog Devices,Inc.Visual DSP++4.0 Assembler and Preprocessor Manual. http://www.analog.com/processors/resources/technicalLibrary/manuals,2005.1
[50] Analog Devices,Inc.Visual DSP++4.0 Linker and Utilities Manual. http://www.analog.com/processors/resources/technicalLibrary/manuals,2005.1
[51] Analog Devices, Inc. Blackfin Processor Instruction Set Reference. http://www.analog.com/processors/resources/technicalLibrary/manuals,2004.6
[52] Analog Devices,Inc.ADSP-BF561 Blackfin Processors Hardware Reference. http://www. analog. com/industry/dsp/tech_doc/gen_purpose.html, 2003. 11
[53] Iain E G Richardson.H.264/MPEG-4 Part 10 White Paper. http://www.vcodex.com,2002
[54] Intel Corporation, "Software Optimization Cookbook".
[55] 嵌入式操作系统一览. http://www. gkong.com/learn/
[56] μClinux官方网站. http://www.uCLinux.org/
[57] Linux论坛.. http://www.linuxforum. net/
[58] C程序优化. http://creativesoft.home.shangdu.net