H.264视频解码器的SystemC实现
摘要
H．264标准是ITU-T的视频编码专家组(VCEG)和ISO／IEC的活动图像专家组(MPEG)的联合视频组(JVT)开发的标准，也称为MPEG-4 AVC，它作为MPEG-4Part10，是“高级视频编码”。在相同的重建图像质量下，H．264比H．263节约50％左右的码率。因其更高的压缩比、更好的IP和无线网络信道的适应性，在数字视频通信和存储领域得到越来越广泛的应用。同时也要注意，H．264获得优越性能的代价是计算复杂度增加，据估计，编码的计算复杂度大约相当于H．263的3倍，解码复杂度大约相当于H．263的2倍。运用先进的SoC芯片解决方案来实现新的视频压缩编码标准H．264／AVC已是大势所趋。
本论文研究H．264 Baseline Profile的视频解码器SoC平台事务级设计，采用SystemC事务级建模语言进行从算法到系统结构级设计过程的验证。在实现的过程中，定义了各个模块之间的接口以及调度策略。由于SoC实现的复杂性，论文重点描述了中央控制单元的和去块效应滤波器的设计要点。最后给出了系统的验证结果。
本论文完成的工作如下：
1)对H．264运动视频编解码标准以及标准解码算法进行研究，对标准算法进行算法级改写。期间，注意使用C++语言的面向对象性，并应考虑硬件结构实现过程的特点，重新安排各个模块的并行结构，以便于将来将其实现成硬件。
2)结合SystemC的体系结构级特性，运用SystemC事务级设计方法，将算法级语言转化为结构上较为接近硬件的系统级语言。期间，综合考虑各个模块之间信号的传递，数据传递方式，以及数据存储类型。并在改写的过程中不断对改写进行验证。
3)研究SystemC的事务级验证方法，并在H．264视频解码器的验证工作中，根据视频解码器特点，提出了主观和客观的验证策略，完成对H．264视频解码器的验证。
The H.264 standard, which is also called MPEG-4 AVC, is developed by the Joint Video Team of ITU-T Video Coding Expert Group (VCEG) and ISO/IEC Moving Picture Expert Group(MPEG). It has been taken as MPEG-4 Part10, "the high-level video encoder". Under the same reconstruction picture quality, H.264 saves about 50% code rate compared to H.263. Because of its higher compression ratio, better IP and the wireless network channel compatibility, it obtains more and more widespread applications in numeral video communication and the storage domain. Need to pay attention at the same time, H. 264 achieves the better quality depend on the complicate calculation. Estimate approximately, Encoder complicated degree is equal to H. 263's 3 times, decoder complicated degree is equal to H. 263's 2 times. Apply the advanced SoC chip to realize new video compression standard is to be the general trend.
First, we have researched the H.264 standard for video coding and decoding in our work. We modify the algorithm and architecture and rewrited into classes. With a view of simultaneity in hardware level, we apply the decode in parallel architecture.
Second, take advantage of the transaction level character, C decoder program is transformed into SystemC program. The facters needed to be noticed include signal transferring method, data transferring method and data storing method. The rewrited program should be validated continually.
Finally, verify the SystemC decoder not only in Subjectivity but also in objectivity.
本论文研究H．264 Baseline Profile的视频解码器SoC平台事务级设计，采用SystemC事务级建模语言进行从算法到系统结构级设计过程的验证。在实现的过程中，定义了各个模块之间的接口以及调度策略。由于SoC实现的复杂性，论文重点描述了中央控制单元的和去块效应滤波器的设计要点。最后给出了系统的验证结果。
本论文完成的工作如下：
1)对H．264运动视频编解码标准以及标准解码算法进行研究，对标准算法进行算法级改写。期间，注意使用C++语言的面向对象性，并应考虑硬件结构实现过程的特点，重新安排各个模块的并行结构，以便于将来将其实现成硬件。
2)结合SystemC的体系结构级特性，运用SystemC事务级设计方法，将算法级语言转化为结构上较为接近硬件的系统级语言。期间，综合考虑各个模块之间信号的传递，数据传递方式，以及数据存储类型。并在改写的过程中不断对改写进行验证。
3)研究SystemC的事务级验证方法，并在H．264视频解码器的验证工作中，根据视频解码器特点，提出了主观和客观的验证策略，完成对H．264视频解码器的验证。
The H.264 standard, which is also called MPEG-4 AVC, is developed by the Joint Video Team of ITU-T Video Coding Expert Group (VCEG) and ISO/IEC Moving Picture Expert Group(MPEG). It has been taken as MPEG-4 Part10, "the high-level video encoder". Under the same reconstruction picture quality, H.264 saves about 50% code rate compared to H.263. Because of its higher compression ratio, better IP and the wireless network channel compatibility, it obtains more and more widespread applications in numeral video communication and the storage domain. Need to pay attention at the same time, H. 264 achieves the better quality depend on the complicate calculation. Estimate approximately, Encoder complicated degree is equal to H. 263's 3 times, decoder complicated degree is equal to H. 263's 2 times. Apply the advanced SoC chip to realize new video compression standard is to be the general trend.
First, we have researched the H.264 standard for video coding and decoding in our work. We modify the algorithm and architecture and rewrited into classes. With a view of simultaneity in hardware level, we apply the decode in parallel architecture.
Second, take advantage of the transaction level character, C decoder program is transformed into SystemC program. The facters needed to be noticed include signal transferring method, data transferring method and data storing method. The rewrited program should be validated continually.
Finally, verify the SystemC decoder not only in Subjectivity but also in objectivity.
引文
[1] 陈曦，徐宁仪．SystemC片上系统设计．北京：科学出版社，2003
[2] 张瑜．多媒体技术．北京：清华大学出版社，北方交通大学出版社，2002
[3] 张国斌．新一代视频应用火爆2006，中外供应商对决编解码芯片市场．见：张毓波主编，电子工程专辑(网上版)：2005，12
[4] 章毓晋．图像处理和分析．北京：清华大学出版社，1999
[5] David C. Black, Jack Donovan. SYSTEMC: FROM THE GROUND UP
[6] SYSTEM C Version 2.0 User's Guide
[7] J.Bhasker. A System C Primer. Star Galaxy Publishing
[8] 王金明，杨吉斌．数字系统设计与Verilog．北京：电子工业出版社，2002
[9] 李波，雷振宇。基于小波域的分形图像压缩。见：北京航空航天大学学报，Vol．24，No．4。北京：北京航空航天大学出版社，1998．
[10] Michael Horowitz, Anthony Joch, Faouzi Kossentini, and etc. H.264/AVC Baseline Profile Decoder Complexity Analysis. In: IEEE Transactions on Circuits and Systems for Video Technology, VOL. 13, NO.7, JULY 2003.
[11] Jan M.Rabaey, Anantha Chandrakasan, Borivoje Nikolic. Digital Integrated Circuits A Design Perspective (Senond Edition). Prentice Hall/Pearson,2004.
[12] Samir Palnitkar. Verilog(?) HDL: A Guide to Digital Design and Synthesis。 Prentice Hall PTR, 2003.
[13] A．Murat TekalP．数字视频处理。北京：清华大学出版社，1997．
[14] H.264/MPEG-4 Part 10 White Paper. Overview ofH.264. Http://www.vcodex.com.
[15] ITU-T. Rec.H264 Series H: Audiovisual and Multimedia Systems. March 2003.
[16] Jan Bormans, Peter List, Detlev Marpe and etc. Video Coding with H.264/AVC:Tools, Performance and Complexity. In IEEE C/RCUITS AND SYSTEMS 2004.
[17] 郑翔，叶志远，周秉锋．JVT草案中的核心技术综述．见：李明树主编．软件学报：Vol．15，No．1．北京，清华大学出版社，2004．58～68．
[18] Iain E. G. Richardson. Video Codec Design. John Wiley & Sons, Ltd. 2002
[19] 沈兰荪，卓力，田栋等．视频编码与低速率传输．北京：电子工业出版社，2001
[20] 朱秀昌，胡栋编．数字图像通信．人民邮电出版社．1994．
[21] 田栋．低速率视频传输关键技术的研究：博士学位论文．北京：北京工业大学，2001．
[22] Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, "Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITUT Rec. H.264 |ISO/IEC 14496-10 AVC)", 2003.3
[23] Joint Video Team (JVT) ofISO/IEC MPEG & ITU-T VCEG,"Proposed Draft Errata List with Revision-Marked Corrections for H.264/AVC", 2003.12
[24] 张益贞，刘滔，“Visual C++实现MPEG／JPEG编解码技术”，北京，人民邮电出版社，2002．11，1-5页
[25] ISO/IEC.IS 13818-1: Information technology - generic coding moving pictures and associated audio information: Systems, 1995. (MPEG-2 Systems)
[26] ISO/IEC.IS 13818-2: Information technology - generic coding moving pictures and associated audio information: Video, 1995. (MPEG-2 Video)
[27] ISO/IEC.IS 13818-3: Information technology - generic coding moving pictures and associated audio information: Audio, 1995. (MPEG-2 Audio)
[28] ISO/IEC.IS 14496-1: Information technology- coding of audio-visual objects-partl: System, 1999 (MPEG-4 System)
[29] ISO/IEC.IS 14496-2: Information technology - coding of audio-visual objects-part2: Visual, 1999 (MPEG-4 Video)
[30] ISO/IEC.IS 14496-3: Information technology- coding of audio-visual objects-part3: Audio, 2000 (MPEG-4 Audio)
[31] ISO/IEC.CD 15938-3: MPEG-7 multimedia content description interface - part3: Visual. 2000
[32] ITU-T. Recommendation H.261: Video codec for audiovisual services at p*64 kbit/s, 1993
[33] ITU-T. Recommendation H.263: Video coding for low bit rate communication, 1998
[34] Yao Wang, Join Ostermann, Ya-Qin Zhang, Video Processing and Communications, Prentice Hall,2003
[35] ISO/IEC. Very low bit rate video codec. Public document, ISO/IEC MPEG96/M0637, Munich, 1996.6 (MPEG-4 VM)
[36] Nejat Kamaci, Yucel Altunbasak, "Performance comparison of emerging H.264 video coding standard with existing standards", IEEE Intl. Conf. On Multimedia and Expo, vol. 1, 2003.6, pp.345-348,
[37] S. Wenger, "H.264/AVC over IP", IEEE Transaction Circuits and System for Video Technology, vol. 13, pp.645-656
[38] Thomas Wiegand, Gary J. Sullivan, Gisle Bjontegaard, etc. "Overview of the H.264/AVC Video Coding Standard", IEEE Transactions on Circuits and System for Video Technology, vol. 13, No. 7, 2003.7, pp560-576
[39] T. Wedi, "Motion compensation in H.264/AVC," IEEE Transaction Circuits and System for Video Technology, vol. 13, 2003.6, pp. 577-586
[40] 沈戈，罗曼，张欣等译，“片上系统---可重用设计方法学”，北京，电子工业出版社，2004．5
[41] 李东晓，姚庆栋，刘鹏等，“HDTV集成解码芯片的一种总线设计，”电路与系统学报，第8卷，第3期，2003．6
[42] MinYong Jeon, Hyunll Byun, etc., "A System-on-Chip Featuring Variable Bus Architecture and Enhanced Video Coprocessors for MPEG-4 Multimedia Applications," IEEE-0-7803-7761-3, 2003
[2] 张瑜．多媒体技术．北京：清华大学出版社，北方交通大学出版社，2002
[3] 张国斌．新一代视频应用火爆2006，中外供应商对决编解码芯片市场．见：张毓波主编，电子工程专辑(网上版)：2005，12
[4] 章毓晋．图像处理和分析．北京：清华大学出版社，1999
[5] David C. Black, Jack Donovan. SYSTEMC: FROM THE GROUND UP
[6] SYSTEM C Version 2.0 User's Guide
[7] J.Bhasker. A System C Primer. Star Galaxy Publishing
[8] 王金明，杨吉斌．数字系统设计与Verilog．北京：电子工业出版社，2002
[9] 李波，雷振宇。基于小波域的分形图像压缩。见：北京航空航天大学学报，Vol．24，No．4。北京：北京航空航天大学出版社，1998．
[10] Michael Horowitz, Anthony Joch, Faouzi Kossentini, and etc. H.264/AVC Baseline Profile Decoder Complexity Analysis. In: IEEE Transactions on Circuits and Systems for Video Technology, VOL. 13, NO.7, JULY 2003.
[11] Jan M.Rabaey, Anantha Chandrakasan, Borivoje Nikolic. Digital Integrated Circuits A Design Perspective (Senond Edition). Prentice Hall/Pearson,2004.
[12] Samir Palnitkar. Verilog(?) HDL: A Guide to Digital Design and Synthesis。 Prentice Hall PTR, 2003.
[13] A．Murat TekalP．数字视频处理。北京：清华大学出版社，1997．
[14] H.264/MPEG-4 Part 10 White Paper. Overview ofH.264. Http://www.vcodex.com.
[15] ITU-T. Rec.H264 Series H: Audiovisual and Multimedia Systems. March 2003.
[16] Jan Bormans, Peter List, Detlev Marpe and etc. Video Coding with H.264/AVC:Tools, Performance and Complexity. In IEEE C/RCUITS AND SYSTEMS 2004.
[17] 郑翔，叶志远，周秉锋．JVT草案中的核心技术综述．见：李明树主编．软件学报：Vol．15，No．1．北京，清华大学出版社，2004．58～68．
[18] Iain E. G. Richardson. Video Codec Design. John Wiley & Sons, Ltd. 2002
[19] 沈兰荪，卓力，田栋等．视频编码与低速率传输．北京：电子工业出版社，2001
[20] 朱秀昌，胡栋编．数字图像通信．人民邮电出版社．1994．
[21] 田栋．低速率视频传输关键技术的研究：博士学位论文．北京：北京工业大学，2001．
[22] Joint Video Team (JVT) of ISO/IEC MPEG & ITU-T VCEG, "Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification (ITUT Rec. H.264 |ISO/IEC 14496-10 AVC)", 2003.3
[23] Joint Video Team (JVT) ofISO/IEC MPEG & ITU-T VCEG,"Proposed Draft Errata List with Revision-Marked Corrections for H.264/AVC", 2003.12
[24] 张益贞，刘滔，“Visual C++实现MPEG／JPEG编解码技术”，北京，人民邮电出版社，2002．11，1-5页
[25] ISO/IEC.IS 13818-1: Information technology - generic coding moving pictures and associated audio information: Systems, 1995. (MPEG-2 Systems)
[26] ISO/IEC.IS 13818-2: Information technology - generic coding moving pictures and associated audio information: Video, 1995. (MPEG-2 Video)
[27] ISO/IEC.IS 13818-3: Information technology - generic coding moving pictures and associated audio information: Audio, 1995. (MPEG-2 Audio)
[28] ISO/IEC.IS 14496-1: Information technology- coding of audio-visual objects-partl: System, 1999 (MPEG-4 System)
[29] ISO/IEC.IS 14496-2: Information technology - coding of audio-visual objects-part2: Visual, 1999 (MPEG-4 Video)
[30] ISO/IEC.IS 14496-3: Information technology- coding of audio-visual objects-part3: Audio, 2000 (MPEG-4 Audio)
[31] ISO/IEC.CD 15938-3: MPEG-7 multimedia content description interface - part3: Visual. 2000
[32] ITU-T. Recommendation H.261: Video codec for audiovisual services at p*64 kbit/s, 1993
[33] ITU-T. Recommendation H.263: Video coding for low bit rate communication, 1998
[34] Yao Wang, Join Ostermann, Ya-Qin Zhang, Video Processing and Communications, Prentice Hall,2003
[35] ISO/IEC. Very low bit rate video codec. Public document, ISO/IEC MPEG96/M0637, Munich, 1996.6 (MPEG-4 VM)
[36] Nejat Kamaci, Yucel Altunbasak, "Performance comparison of emerging H.264 video coding standard with existing standards", IEEE Intl. Conf. On Multimedia and Expo, vol. 1, 2003.6, pp.345-348,
[37] S. Wenger, "H.264/AVC over IP", IEEE Transaction Circuits and System for Video Technology, vol. 13, pp.645-656
[38] Thomas Wiegand, Gary J. Sullivan, Gisle Bjontegaard, etc. "Overview of the H.264/AVC Video Coding Standard", IEEE Transactions on Circuits and System for Video Technology, vol. 13, No. 7, 2003.7, pp560-576
[39] T. Wedi, "Motion compensation in H.264/AVC," IEEE Transaction Circuits and System for Video Technology, vol. 13, 2003.6, pp. 577-586
[40] 沈戈，罗曼，张欣等译，“片上系统---可重用设计方法学”，北京，电子工业出版社，2004．5
[41] 李东晓，姚庆栋，刘鹏等，“HDTV集成解码芯片的一种总线设计，”电路与系统学报，第8卷，第3期，2003．6
[42] MinYong Jeon, Hyunll Byun, etc., "A System-on-Chip Featuring Variable Bus Architecture and Enhanced Video Coprocessors for MPEG-4 Multimedia Applications," IEEE-0-7803-7761-3, 2003