基于MB86H51的H.264视频编解码系统的设计与实现
摘要
随着信息技术的发展,人类进入了一个全新的多媒体时代,图像和视频传输与处理作为多媒体通信中最重要的通信手段,也随着时代的发展取得了长足的进步。ISO和ITU-T制定了一系列的视频编码国际标准,目前,H.264视频压缩编码标准凭借高压缩比和图像质量已经成为一种新型的标准被广泛地接受。同时,超大规模集成电路技术(VLSI)、可编程逻辑器件(FPGA)的发展和一些视频编解码芯片的出现使实时的视频压缩和传输成为可能。因此,基于FPGA和一些成熟的视频编解码芯片进行系统设计具有重要的实际意义。
本文基于视频编解码芯片——MB86H51和FPGA设计并实现了一套H.264视频编解码系统,并且搭建出一个系统平台使MB86H51芯片完成以DVI作为视频输入输出接口的H.264视频编解码功能。MB86H51芯片是富士通(Fujitsu)推出的高清H.264视频编解码芯片,它可以半双工地完成包括视频、音频和系统的H.264/AVC编码和解码。本文首先介绍了H.264视频压缩编码的原理,并对其关键技术进行了系统的分析;然后对视频编解码芯片MB86H51的功能特性和接口进行了详细的介绍;最后,对基于MB86H51芯片和FPGA设计实现的H.264视频编解码系统的设计方法和实现方案做了详细阐述。
经过验证,本文设计实现的这套H.264视频编解码系统达到了实时编码和解码的要求,并且极大地缩减了开发周期、降低了开发成本。
With the rapid development of information technology, man has entered a brand-new multimedia age. Image/Video transmission and processing, as the most important way of communication in multimedia, has progressed quite a lot. ISO and ITU-T have put forward a series of international standard of video codec. At present, based on its high compression ratio and better image quality, the new standard of video compression, H.264 has been widely accepted and used in many applications. At the same time, the development of Very Large Scale Integrate circuit (VLSI) and Programmable Logic Device (FPGA) and the emergence of video codec LSI chip makes it is possible for the real-time video compression and transportation. Therefore, it is of great significance to design a video codec system based on FPGA and some mature chip.
This paper design and implement an H.264 video codec system based on the chip of video codec-MB86H51 and FPGA. A system platform is built that enables the chip of MB86H51 to complete the function of H.264 codec with DVI as the video input and output interfaces. MB86H51 is a H.264 video codec chip manufactured by the company of Fujitsu. It is a half-duplex codec LSI chip that executes encoding and decoding processing including video, audio, and system processing in an H.264/AVC system. This paper firstly introduces the principle of the H.264 video encoding system and makes some analysis on its key techniques. Secondly, it introduced the function, main specifications and interface of MB86H51 in detail. Finally, the paper introduced the design method and the realized scheme of the H.264 video codec system based on MB86H51 and FPGA in detail.
This H.264 video codec system has been verified and meets the requirements of the real-time video codec. Moreover, it reduces the development cycle and cost greatly.
本文基于视频编解码芯片——MB86H51和FPGA设计并实现了一套H.264视频编解码系统,并且搭建出一个系统平台使MB86H51芯片完成以DVI作为视频输入输出接口的H.264视频编解码功能。MB86H51芯片是富士通(Fujitsu)推出的高清H.264视频编解码芯片,它可以半双工地完成包括视频、音频和系统的H.264/AVC编码和解码。本文首先介绍了H.264视频压缩编码的原理,并对其关键技术进行了系统的分析;然后对视频编解码芯片MB86H51的功能特性和接口进行了详细的介绍;最后,对基于MB86H51芯片和FPGA设计实现的H.264视频编解码系统的设计方法和实现方案做了详细阐述。
经过验证,本文设计实现的这套H.264视频编解码系统达到了实时编码和解码的要求,并且极大地缩减了开发周期、降低了开发成本。
With the rapid development of information technology, man has entered a brand-new multimedia age. Image/Video transmission and processing, as the most important way of communication in multimedia, has progressed quite a lot. ISO and ITU-T have put forward a series of international standard of video codec. At present, based on its high compression ratio and better image quality, the new standard of video compression, H.264 has been widely accepted and used in many applications. At the same time, the development of Very Large Scale Integrate circuit (VLSI) and Programmable Logic Device (FPGA) and the emergence of video codec LSI chip makes it is possible for the real-time video compression and transportation. Therefore, it is of great significance to design a video codec system based on FPGA and some mature chip.
This paper design and implement an H.264 video codec system based on the chip of video codec-MB86H51 and FPGA. A system platform is built that enables the chip of MB86H51 to complete the function of H.264 codec with DVI as the video input and output interfaces. MB86H51 is a H.264 video codec chip manufactured by the company of Fujitsu. It is a half-duplex codec LSI chip that executes encoding and decoding processing including video, audio, and system processing in an H.264/AVC system. This paper firstly introduces the principle of the H.264 video encoding system and makes some analysis on its key techniques. Secondly, it introduced the function, main specifications and interface of MB86H51 in detail. Finally, the paper introduced the design method and the realized scheme of the H.264 video codec system based on MB86H51 and FPGA in detail.
This H.264 video codec system has been verified and meets the requirements of the real-time video codec. Moreover, it reduces the development cycle and cost greatly.
引文
[1].毕厚杰.新一代视频压缩编码标准——H.264/AVC,北京:人民邮电出版社,2005
[2].刘海鹰,张兆杨,沈礼权.基于FPGA的H.264变换量化的高性能的硬件实现,中国图像图形学报,2006
[3].李清扬,伍瑞卿,樊丰.H.264整数DCT变换与量化系统实现,Digital TV & digital video,2006
[4].郭建军.H.264视频编码若干关键优化技术的研究与实现,国防科学技术大学研究生院硕士学位论文,2005
[5].易峰.视频编码中去块滤波技术的原理与算法研究,浙江大学硕士学位论文,2006
[6].王小龙,许超.H.264中自适应二进制算术编码器的FPGA实现,中国通信集成电路技术与应用研讨会论文集,2004
[7].刘朋瑞,郭炜,付宇卓.基于乘法元的查表法实现的色彩空间转换,计算机工程,第33卷,第16期,2007.8
[8].陈晨.H.264/AVC视频帧内解码的VLSI实现研究,西安电子科技大学硕士论文,2006
[9].杨立成.基于FPGA的视频编解码器系统设计与实现,西安电子科技大学硕士论文,2009
[10].齐文钊.基于FPGA的视频编码器设计,天津大学硕士学位论文,2004
[11].张欣,张春华.基于FPGA的视频图像实时处理技术,计算机技术与应用发展,2004
[12]. Atul Puri,Xuemin Chen,Ajay Luthra. Video coding using the H.264/MPEG-4 AVC compression standard, Signal Processing:Image Communication 19(2004) 793-849
[13]. Iain E.G. Richardson. H.264 and MPEG-4 Video Compression, Video Coding for Next-generation Multimedia. Wiley. 2003.
[14]. Iain E.G. Richardson. Video Codec Design. Developing Image and Video Compression Systems. John Wiley, 2002.
[15]. ITU-T Recommendation H.264. INTERNATIONAL STANDARD ISO/IEC 14496-10:2005 (E)
[16]. ITU-T Recommendation H.264. Advanced video coding for generic audiovisualservices,2005
[17]. Fujitsu. H.264 Codec LSI MB86H51 Product Specifications,Revision 1.03 26 July 2007
[18]. Yun Zhang,Gangyi Jiang,Wenjuan,Yi,Mei Yu,Fucui Li,Zhidi Jiang,Weiyue Liu.An Improved Design of Quantization for H.264 Video Coding Standard,ICSP2006 Proceedings
[19]. Jing X., Chau L. An efficient inter mode decision approach for H.264 video coding,Int. Conf. on Multimedia and Expo.,2:1111-1114,Jun 2004
[20]. Yu-Wen Huang,Bing-Yu Hsieh,Tung-Chien Chen,and Liang-Gee Chen,Fellow, IEEE. Analysis, Fast Algorithm, and VLSI Architecture Design for H.264/AVC Intra Frame Coder. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 3, MARCH 2005
[21]. Kuan-Hung Chen,Jiun-In Guo, Member,and Jinn-Shyan Wang, Member. A High-Performance Direct 2-D Transform Coding IP Design for MPEG-4 AVC/H.264. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 4, APRIL 2006
[22]. Ye Jianhong,Liu Jilin. Fast Parallel Implementation of H.264 /AVC Transform Exploiting SIMD Instructions, Proceedings of 2007 International Symposium on Intelligent Signal Processing and Communication Systems Nov.28-Dec.1, 2007
[23]. D.Wu,F.Pan,K.P.Lim,S.Wu,Z.G.Li,X.Lin,S.Rahardja,and C.C.Ko.Fast Intermode Decision in H.264/AVC Video Coding,IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 6, JULY 2005
[24]. GARY J.SULLIVAN, SENIOR MEMBER, IEEE AND THOMAS WIEGAND.Video Compression-From Concepts to the H.264/AVC Standard, PROCEEDINGS OF THE IEEE, VOL. 93, NO. 1, JANUARY 2005
[25]. Sullivan G.J., Wiegand T., Video Compression From Concepts to the H.264/AVC Standard, Proc. of The IEEE.93(1):18-31,Jan.2005
[26]. Yuh-Jue Chuang,Ja-Ling Wu, An Efficient Matrix-Based DCT Splitter/Merger for MPEG-2-to-AVC/H.264 Transform Kernel Conversion, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,VOL.17,NO.1,JANUARY 2007
[27]. K.K.Ong, W.H.Chang, Y.C.Tseng, Y.S.Lee. A High Throughout Low Cost Context-Based Adaptive Arithmetic Coder for Multiple Standards,IEEE International Conference on Image Processing,Vol:1,Pages:872-875,Sept.2002
[28]. Kuan-Hung Chen,Jiun-In Guo,Member,and Jinn-Shyan Wang,Member.A High-Performance Direct 2-D Transform Coding IP Design for MPEG-4 AVC/H.264, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 4, APRIL 2006
[2].刘海鹰,张兆杨,沈礼权.基于FPGA的H.264变换量化的高性能的硬件实现,中国图像图形学报,2006
[3].李清扬,伍瑞卿,樊丰.H.264整数DCT变换与量化系统实现,Digital TV & digital video,2006
[4].郭建军.H.264视频编码若干关键优化技术的研究与实现,国防科学技术大学研究生院硕士学位论文,2005
[5].易峰.视频编码中去块滤波技术的原理与算法研究,浙江大学硕士学位论文,2006
[6].王小龙,许超.H.264中自适应二进制算术编码器的FPGA实现,中国通信集成电路技术与应用研讨会论文集,2004
[7].刘朋瑞,郭炜,付宇卓.基于乘法元的查表法实现的色彩空间转换,计算机工程,第33卷,第16期,2007.8
[8].陈晨.H.264/AVC视频帧内解码的VLSI实现研究,西安电子科技大学硕士论文,2006
[9].杨立成.基于FPGA的视频编解码器系统设计与实现,西安电子科技大学硕士论文,2009
[10].齐文钊.基于FPGA的视频编码器设计,天津大学硕士学位论文,2004
[11].张欣,张春华.基于FPGA的视频图像实时处理技术,计算机技术与应用发展,2004
[12]. Atul Puri,Xuemin Chen,Ajay Luthra. Video coding using the H.264/MPEG-4 AVC compression standard, Signal Processing:Image Communication 19(2004) 793-849
[13]. Iain E.G. Richardson. H.264 and MPEG-4 Video Compression, Video Coding for Next-generation Multimedia. Wiley. 2003.
[14]. Iain E.G. Richardson. Video Codec Design. Developing Image and Video Compression Systems. John Wiley, 2002.
[15]. ITU-T Recommendation H.264. INTERNATIONAL STANDARD ISO/IEC 14496-10:2005 (E)
[16]. ITU-T Recommendation H.264. Advanced video coding for generic audiovisualservices,2005
[17]. Fujitsu. H.264 Codec LSI MB86H51 Product Specifications,Revision 1.03 26 July 2007
[18]. Yun Zhang,Gangyi Jiang,Wenjuan,Yi,Mei Yu,Fucui Li,Zhidi Jiang,Weiyue Liu.An Improved Design of Quantization for H.264 Video Coding Standard,ICSP2006 Proceedings
[19]. Jing X., Chau L. An efficient inter mode decision approach for H.264 video coding,Int. Conf. on Multimedia and Expo.,2:1111-1114,Jun 2004
[20]. Yu-Wen Huang,Bing-Yu Hsieh,Tung-Chien Chen,and Liang-Gee Chen,Fellow, IEEE. Analysis, Fast Algorithm, and VLSI Architecture Design for H.264/AVC Intra Frame Coder. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 3, MARCH 2005
[21]. Kuan-Hung Chen,Jiun-In Guo, Member,and Jinn-Shyan Wang, Member. A High-Performance Direct 2-D Transform Coding IP Design for MPEG-4 AVC/H.264. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 4, APRIL 2006
[22]. Ye Jianhong,Liu Jilin. Fast Parallel Implementation of H.264 /AVC Transform Exploiting SIMD Instructions, Proceedings of 2007 International Symposium on Intelligent Signal Processing and Communication Systems Nov.28-Dec.1, 2007
[23]. D.Wu,F.Pan,K.P.Lim,S.Wu,Z.G.Li,X.Lin,S.Rahardja,and C.C.Ko.Fast Intermode Decision in H.264/AVC Video Coding,IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 15, NO. 6, JULY 2005
[24]. GARY J.SULLIVAN, SENIOR MEMBER, IEEE AND THOMAS WIEGAND.Video Compression-From Concepts to the H.264/AVC Standard, PROCEEDINGS OF THE IEEE, VOL. 93, NO. 1, JANUARY 2005
[25]. Sullivan G.J., Wiegand T., Video Compression From Concepts to the H.264/AVC Standard, Proc. of The IEEE.93(1):18-31,Jan.2005
[26]. Yuh-Jue Chuang,Ja-Ling Wu, An Efficient Matrix-Based DCT Splitter/Merger for MPEG-2-to-AVC/H.264 Transform Kernel Conversion, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,VOL.17,NO.1,JANUARY 2007
[27]. K.K.Ong, W.H.Chang, Y.C.Tseng, Y.S.Lee. A High Throughout Low Cost Context-Based Adaptive Arithmetic Coder for Multiple Standards,IEEE International Conference on Image Processing,Vol:1,Pages:872-875,Sept.2002
[28]. Kuan-Hung Chen,Jiun-In Guo,Member,and Jinn-Shyan Wang,Member.A High-Performance Direct 2-D Transform Coding IP Design for MPEG-4 AVC/H.264, IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, VOL. 16, NO. 4, APRIL 2006