H.264帧内预测算法研究与硬件设计
摘要
随着IPTV、移动视频等新兴视频应用的兴起，之前的视频压缩技术已经逐渐地难以满足这些业务对视频应用的各方面需求。一个新的视频压缩标准—H.264应运而生。该标准作为历来标准的集大成者，除了更出色的性能及更好的网络友好性外，作为国际标准和公正的无差别许可制度也至关重要。因此，H.264受到了众多行业的青睐。
FPGA与传统逻辑电路和门阵列相比具有不同的结构。FPGA利用小型查找表来实现组合逻辑，其结构允许无限次的重新编程。由于FPGA的性能和灵活性，以及新的简明的设计和实施方法，在很多新兴DSP应用领域，如数字通信和视频处理，FPGA都成为优选的解决方案。
本文重点对H.264标准中的帧内预测算法进行研究。在分析现有的帧内预测优化算法的基础上，提出了一种基于选择前一预测模式作为当前首选预测模式的快速算法，并用MATLAB进行了验证。实验表明，本文所提出的快速算法有一定的优越性和实用价值。同时，本文对FPGA的相关技术进行了研究，结合H.264的帧内预测器这一计算密集型应用，完成了帧内预测器的FPGA实现。此外，设计了LCD显示模块来显示设计所得到的最佳预测模式及其代价值，从而构成了完整的基于FPGA的帧内预测器。并编写了C代码来验证所设计的帧内预测器的结果。
最后，本文对所研究的成果做出了总结，并提出了将来努力的方向。
With the new application's emergence of IPTV and mobile video, it becomes more and more difficult for previous video compression technologies to satisfy many demands of video application gradually. A new video compression standard-H.264 is proposed. It integrates many advantages of the previous standards. And it gets many industries' favor not only by right of its excellent performance and better network friendship, but also as the international standard and candid indiscrimination admission system.
Compared with traditional logic circuits and gate arrays, FPGAs have different structures. Small lookup tables are used to achieve combinational logics and unlimited re-programming is allowed in their structures. As FPGAs' performance and flexibility, and their new simple method of design and implementation, FPGAs become the optimized solutions in many emerging DSP application fields, such as digital communication and video processing and so on.
After detailed introducing H.264, this paper focuses on the intra prediction algorithm. Based on analyzing the existing fast intra prediction algorithm, a fast intra prediction algorithm is proposed which chooses the previous prediction mode as the current model's preferred mode. And it was verified by using MATLAB. Experiments show that the fast algorithm proposed has a certain degree of superiority and practical value. This paper studies the FPGA technology also, and then combines the H.264 intra prediction to realize the intra predictor by using FPGA. In addition, a LCD display module is designed to show the best prediction mode and its cost value. Thereby, a complete FPGA-based intra predictor is done in this paper. And it's verified by C language.
Finally, the research results are summarized and the future works are proposed in the paper.
FPGA与传统逻辑电路和门阵列相比具有不同的结构。FPGA利用小型查找表来实现组合逻辑，其结构允许无限次的重新编程。由于FPGA的性能和灵活性，以及新的简明的设计和实施方法，在很多新兴DSP应用领域，如数字通信和视频处理，FPGA都成为优选的解决方案。
本文重点对H.264标准中的帧内预测算法进行研究。在分析现有的帧内预测优化算法的基础上，提出了一种基于选择前一预测模式作为当前首选预测模式的快速算法，并用MATLAB进行了验证。实验表明，本文所提出的快速算法有一定的优越性和实用价值。同时，本文对FPGA的相关技术进行了研究，结合H.264的帧内预测器这一计算密集型应用，完成了帧内预测器的FPGA实现。此外，设计了LCD显示模块来显示设计所得到的最佳预测模式及其代价值，从而构成了完整的基于FPGA的帧内预测器。并编写了C代码来验证所设计的帧内预测器的结果。
最后，本文对所研究的成果做出了总结，并提出了将来努力的方向。
With the new application's emergence of IPTV and mobile video, it becomes more and more difficult for previous video compression technologies to satisfy many demands of video application gradually. A new video compression standard-H.264 is proposed. It integrates many advantages of the previous standards. And it gets many industries' favor not only by right of its excellent performance and better network friendship, but also as the international standard and candid indiscrimination admission system.
Compared with traditional logic circuits and gate arrays, FPGAs have different structures. Small lookup tables are used to achieve combinational logics and unlimited re-programming is allowed in their structures. As FPGAs' performance and flexibility, and their new simple method of design and implementation, FPGAs become the optimized solutions in many emerging DSP application fields, such as digital communication and video processing and so on.
After detailed introducing H.264, this paper focuses on the intra prediction algorithm. Based on analyzing the existing fast intra prediction algorithm, a fast intra prediction algorithm is proposed which chooses the previous prediction mode as the current model's preferred mode. And it was verified by using MATLAB. Experiments show that the fast algorithm proposed has a certain degree of superiority and practical value. This paper studies the FPGA technology also, and then combines the H.264 intra prediction to realize the intra predictor by using FPGA. In addition, a LCD display module is designed to show the best prediction mode and its cost value. Thereby, a complete FPGA-based intra predictor is done in this paper. And it's verified by C language.
Finally, the research results are summarized and the future works are proposed in the paper.
引文
[1] 毕厚杰．新一代视频压缩编码标准—H.264／AVC．第一版．人民邮电出版社．2005年5月．pp．25～50
[2] 于保成．低码流H.264视频编码算法及FPGA实现探讨．中国海洋大学．2005年．pp．2～13
[3] Thomas. Wiegand, Gary. J. Sullivan. The H.264/AVC Video Coding Standard. IEEE Signal Processing Magazine. 2007(3).pp.148～153
[4] lain E G Richardson. H.264/MPEG-4 Part 10 White Papers. 2003. pp.1
[5] ISOflec and ITU-T. Joint Video Team(Jvt). Advanced Video Coding for Generic Audiovisual Services. 2005(3).pp.241～251
[6] Gary J, Sullivan, Pankai Topiwala, Ajay Luthra. The H.264/AVC Advanced Video Coding Standard: Overview And Introduction To The Fidelity Range Extensions. SPIE Conference on Application of Digital Image Processing.2004.
[7] Thomas Wiegand, Gary J.Sullivan Et Al. Overview of the H.264/AVC Video Coding Standard. IEEE Transaction on Circuits and Systems for Video Technology. 2003. pp.1～2
[8] Atul Puria, Xuemin Chenb, Ajay Luthra. Video Coding Using the H.264/MPEG-4 AVC Compression Standard. Signal Processing: Image Communication. 2004.pp.793～849
[9] 裴世保，李厚强，俞能海．H.264／AVC帧内预测模式选择算法研究．计算机应用．2005(8)．pp．1808～1810
[10] Anthony Joch, Faouzi Kossentini And Panos Nasiopulos. A Performance Analysis of The ITU-T Draft H.26LVideo Coding Standard. Proceedings of Packet Video Workshop. 2002
[11] Panos Nasiopoulos, Anthony Joch Arid Faouzi Kossentini. Overview and Performance Evaluation of The ITU-T Draft H.26L Video Coding Standard. Proceedings of SPIE of Digital Image Processing. 2001
[12] 沈兰荪，卓力等．小波编码与网络视频传输．科学出版社．2005．pp．98～120
[13] lain E. G. Richardson. H.264 and MPEG-4 Video Compression—Video Coding for Next-generation Multimedia.2003.pp. 198～207
[14] 刘峰．视频图像编码技术及国际标准．北京邮电大学出版社．2005．pp．243
[15] 周恒．H.264的研究与软件实现．南京：南京邮电学院，2003．pp．3
[16] PAN F, LIN X, RAHARDJA S. et al.JVT—GOI 3, Fast Mode Decision for Intra Prediction. JVT of ISO/IEC MPEG&ITU—T VCEG, 2003.
[17] KIM C, SHIH H—H, KUO C—CJ. Multistage mode decision for intra prediction in H.264 codec[A]. 16th Annual Symposium Electric Imaging, 2004.
[18] 谢晶，贾克斌．一种基于二维直方图的H.264／AVC快速帧内预测判决算法．电子与信息学报．2005．pp．1053～1057
[19] 朱光喜，戴声奎，刘文予，喻莉．一种复杂度可分级的帧内预测方法．微电子学与计算机．2005年第22卷第3期．pp．211～214
[20] F.Pan, X.Lin, S.Rahardja, K.P.Lim, Z.G.Li, D.Wu, S.Wu. Fast Intra Mode Decision Algorithm for H.264/AVC Video Coding. 2004 International Conference on Image Processing (ICIP).2004.pp.781～784
[21] Meng.B, Au.O.C, Chi-Wah Wong, Hong-Kwai Lam. Efficient intra-prediction mode selection for 4×4 blocks in H.264. Proc. of Int. Conf. on Multimedia and Expo. 2003.Vol.3.pp.521～524
[22] Meng.B, Au.O.C. Fast Intra-Prediction Mode Selection for 4×4 blocks in H.264. Proc. of IEEE Int. Conf. on Acoustics, Speech, and Signal. 2003. Vol. 3.
[23] 倪伟，郭宝龙，杨锣．一种适用于H.264／AVC的自适应空域帧内预测算法[J]．计算机学报．2005(11)．pp．1853～1860
[24] 丁鬼广，郭宝龙．基于H.26L的精细度可伸缩视频编码[J]．通信学报，2004，25(9)．pp．132～139．
[25] http://fpga.com
[26] 杜川华，詹峻岭，徐曦．反熔丝FPGA延时电路γ瞬时辐射效应．强激光与粒子束．2006，02．pp．321～324
[27] Altera公司．Quartus Ⅱ简介．6.0版．2006年3月．pp．166
[28] http://www.altera.com
[29] Maria G. Koziri, George I. Stamoulis, Ioannis X. Katsvounidis. A Low-Power VLSI architecture for Intra and Inter prediction in H.264. IEEE Trans. Circuit and Systems for Video Technology.2006.pp.109～112
[30] Y. W. Huang, B. Y. Hsieh, T. C. Chen and L. G. Chen. Analysis, Fast Algorithm, and VLSI Architecture Design for H.264/AVC Intra Frame Coder. IEEE Trans. Circuit and Systems for Video Technology. Vol. 15, No 3.Mar. 2005. pp.378～401
[31] Genhua Jin, Jin-Su Jung and Hyuk-Jae Lee. An Efficient Pipelined Architecture for H.264/AVC Intra Frame Processing. IEEE Trans. Circuit and Systems for Video Technology. 2007.pp. 1605～1608
[32] K. Suh, S. Park, and H. Cho. An Efficient Hardware Architecture of Intra Prediction and TQ/IQIT Module for H.264 Encoder. ETRI Journal. Vol 27. No. 5. Oct.2005. pp.511～524
[33] Genhua Jin, Hyuk-Jae Lee. A Parallel and Pipelined Execution of H.264/AVC Intra Prediction. Proceedings of The Sixth IEEE International Conference on Computer and Information Technology. 2006.
[34] W. ZOUCH, A. SAMET, M. A. BEN AYED, E KOSSENTINI, N. MASMOUDI. Complexity Analysis of Intra Prediction in H.264/AVC. IEEE Trans. Circuit and Systems for Video Technology. 2004.pp.713～717
[35] 刘凌志，路奇，戎蒙恬，郑世宝．一种并行结构的H.264帧内预测器．上海交通大学学报．第40卷．2004．12．pp54～58
[36] 吴继华，王诚．Altera FPGA／CPLD设计(高级篇)．第二版．人民邮电出版社．2005年12月．P：151～160
[37] http://blog.csdn.net
[38] 吴继华，王诚，范丽珍，薛宁，薛小刚．Altera FPGA／CPLD设计(基础篇)．人民邮电出版社．2005年7月．pp．148～151
[39] Stephane Mallat．A Wavelet Tour of Signal Processing．Second Edition．北京机械工业出版社．2002年9月．pp132～150
[2] 于保成．低码流H.264视频编码算法及FPGA实现探讨．中国海洋大学．2005年．pp．2～13
[3] Thomas. Wiegand, Gary. J. Sullivan. The H.264/AVC Video Coding Standard. IEEE Signal Processing Magazine. 2007(3).pp.148～153
[4] lain E G Richardson. H.264/MPEG-4 Part 10 White Papers. 2003. pp.1
[5] ISOflec and ITU-T. Joint Video Team(Jvt). Advanced Video Coding for Generic Audiovisual Services. 2005(3).pp.241～251
[6] Gary J, Sullivan, Pankai Topiwala, Ajay Luthra. The H.264/AVC Advanced Video Coding Standard: Overview And Introduction To The Fidelity Range Extensions. SPIE Conference on Application of Digital Image Processing.2004.
[7] Thomas Wiegand, Gary J.Sullivan Et Al. Overview of the H.264/AVC Video Coding Standard. IEEE Transaction on Circuits and Systems for Video Technology. 2003. pp.1～2
[8] Atul Puria, Xuemin Chenb, Ajay Luthra. Video Coding Using the H.264/MPEG-4 AVC Compression Standard. Signal Processing: Image Communication. 2004.pp.793～849
[9] 裴世保，李厚强，俞能海．H.264／AVC帧内预测模式选择算法研究．计算机应用．2005(8)．pp．1808～1810
[10] Anthony Joch, Faouzi Kossentini And Panos Nasiopulos. A Performance Analysis of The ITU-T Draft H.26LVideo Coding Standard. Proceedings of Packet Video Workshop. 2002
[11] Panos Nasiopoulos, Anthony Joch Arid Faouzi Kossentini. Overview and Performance Evaluation of The ITU-T Draft H.26L Video Coding Standard. Proceedings of SPIE of Digital Image Processing. 2001
[12] 沈兰荪，卓力等．小波编码与网络视频传输．科学出版社．2005．pp．98～120
[13] lain E. G. Richardson. H.264 and MPEG-4 Video Compression—Video Coding for Next-generation Multimedia.2003.pp. 198～207
[14] 刘峰．视频图像编码技术及国际标准．北京邮电大学出版社．2005．pp．243
[15] 周恒．H.264的研究与软件实现．南京：南京邮电学院，2003．pp．3
[16] PAN F, LIN X, RAHARDJA S. et al.JVT—GOI 3, Fast Mode Decision for Intra Prediction. JVT of ISO/IEC MPEG&ITU—T VCEG, 2003.
[17] KIM C, SHIH H—H, KUO C—CJ. Multistage mode decision for intra prediction in H.264 codec[A]. 16th Annual Symposium Electric Imaging, 2004.
[18] 谢晶，贾克斌．一种基于二维直方图的H.264／AVC快速帧内预测判决算法．电子与信息学报．2005．pp．1053～1057
[19] 朱光喜，戴声奎，刘文予，喻莉．一种复杂度可分级的帧内预测方法．微电子学与计算机．2005年第22卷第3期．pp．211～214
[20] F.Pan, X.Lin, S.Rahardja, K.P.Lim, Z.G.Li, D.Wu, S.Wu. Fast Intra Mode Decision Algorithm for H.264/AVC Video Coding. 2004 International Conference on Image Processing (ICIP).2004.pp.781～784
[21] Meng.B, Au.O.C, Chi-Wah Wong, Hong-Kwai Lam. Efficient intra-prediction mode selection for 4×4 blocks in H.264. Proc. of Int. Conf. on Multimedia and Expo. 2003.Vol.3.pp.521～524
[22] Meng.B, Au.O.C. Fast Intra-Prediction Mode Selection for 4×4 blocks in H.264. Proc. of IEEE Int. Conf. on Acoustics, Speech, and Signal. 2003. Vol. 3.
[23] 倪伟，郭宝龙，杨锣．一种适用于H.264／AVC的自适应空域帧内预测算法[J]．计算机学报．2005(11)．pp．1853～1860
[24] 丁鬼广，郭宝龙．基于H.26L的精细度可伸缩视频编码[J]．通信学报，2004，25(9)．pp．132～139．
[25] http://fpga.com
[26] 杜川华，詹峻岭，徐曦．反熔丝FPGA延时电路γ瞬时辐射效应．强激光与粒子束．2006，02．pp．321～324
[27] Altera公司．Quartus Ⅱ简介．6.0版．2006年3月．pp．166
[28] http://www.altera.com
[29] Maria G. Koziri, George I. Stamoulis, Ioannis X. Katsvounidis. A Low-Power VLSI architecture for Intra and Inter prediction in H.264. IEEE Trans. Circuit and Systems for Video Technology.2006.pp.109～112
[30] Y. W. Huang, B. Y. Hsieh, T. C. Chen and L. G. Chen. Analysis, Fast Algorithm, and VLSI Architecture Design for H.264/AVC Intra Frame Coder. IEEE Trans. Circuit and Systems for Video Technology. Vol. 15, No 3.Mar. 2005. pp.378～401
[31] Genhua Jin, Jin-Su Jung and Hyuk-Jae Lee. An Efficient Pipelined Architecture for H.264/AVC Intra Frame Processing. IEEE Trans. Circuit and Systems for Video Technology. 2007.pp. 1605～1608
[32] K. Suh, S. Park, and H. Cho. An Efficient Hardware Architecture of Intra Prediction and TQ/IQIT Module for H.264 Encoder. ETRI Journal. Vol 27. No. 5. Oct.2005. pp.511～524
[33] Genhua Jin, Hyuk-Jae Lee. A Parallel and Pipelined Execution of H.264/AVC Intra Prediction. Proceedings of The Sixth IEEE International Conference on Computer and Information Technology. 2006.
[34] W. ZOUCH, A. SAMET, M. A. BEN AYED, E KOSSENTINI, N. MASMOUDI. Complexity Analysis of Intra Prediction in H.264/AVC. IEEE Trans. Circuit and Systems for Video Technology. 2004.pp.713～717
[35] 刘凌志，路奇，戎蒙恬，郑世宝．一种并行结构的H.264帧内预测器．上海交通大学学报．第40卷．2004．12．pp54～58
[36] 吴继华，王诚．Altera FPGA／CPLD设计(高级篇)．第二版．人民邮电出版社．2005年12月．P：151～160
[37] http://blog.csdn.net
[38] 吴继华，王诚，范丽珍，薛宁，薛小刚．Altera FPGA／CPLD设计(基础篇)．人民邮电出版社．2005年7月．pp．148～151
[39] Stephane Mallat．A Wavelet Tour of Signal Processing．Second Edition．北京机械工业出版社．2002年9月．pp132～150