H.264编码器算法优化与设计
|
摘要
基于H.264的视频产品的开发将是视频产品发展的趋势,本文对H.264编码器算法进行优化与设计,得出一个适用于IP网络环境的低复杂度H.264编码器算法。
第一章阐述了视频压缩技术以及网络技术的发展情况,指出对H.264编码器算法进行优化与设计的意义。
第二章论述了H.264标准的特点和发展情况,对其编码过程以及主要算法作了详细分析。
第三章分析H.264编码器的高复杂度的产生来源,详细论述如何通过优化算法选项、优化算法结构、设计快速算法,实现一个适合移植到各平台的低复杂度H.264软件编码器。
第四章详细论述如何设计低复杂度的网络差错消隐方法,使H.264编码器能适应IP网络的丢包环境。
第五章总结全文主要工作,对未来H.264编码器的发展进行了展望。
Development of products based on H.264 is the trend of video products development. The H.264 encoder is optimized and designed in this thesis, a low complexity H.264 encoder for IP network is presented.Chapter 1 describes the development of video codec technology and network, and illustrates the importance of H.264 encoder and design.Chapter 2 introduces the character and development of H.264 standard, analyses the encoder process and main algorithm in detail.Chapter 3 discusses the source of high complexity in H.264 encoder, detailed introduces how to realize a low complexity H.264 encoder that easy to port to all platforms by optimizing the encode algorithm options, adjusting the algorithm flow, and designing quick algorithms.Chapter 4 detailed discusses how to design a low complexity error resilience algorithm to make the H.264 encoder fit for IP network.Chapter 5 summarizes the work of this thesis, and makes a forward looking on the development trend of the video product based on H.264.
第一章阐述了视频压缩技术以及网络技术的发展情况,指出对H.264编码器算法进行优化与设计的意义。
第二章论述了H.264标准的特点和发展情况,对其编码过程以及主要算法作了详细分析。
第三章分析H.264编码器的高复杂度的产生来源,详细论述如何通过优化算法选项、优化算法结构、设计快速算法,实现一个适合移植到各平台的低复杂度H.264软件编码器。
第四章详细论述如何设计低复杂度的网络差错消隐方法,使H.264编码器能适应IP网络的丢包环境。
第五章总结全文主要工作,对未来H.264编码器的发展进行了展望。
Development of products based on H.264 is the trend of video products development. The H.264 encoder is optimized and designed in this thesis, a low complexity H.264 encoder for IP network is presented.Chapter 1 describes the development of video codec technology and network, and illustrates the importance of H.264 encoder and design.Chapter 2 introduces the character and development of H.264 standard, analyses the encoder process and main algorithm in detail.Chapter 3 discusses the source of high complexity in H.264 encoder, detailed introduces how to realize a low complexity H.264 encoder that easy to port to all platforms by optimizing the encode algorithm options, adjusting the algorithm flow, and designing quick algorithms.Chapter 4 detailed discusses how to design a low complexity error resilience algorithm to make the H.264 encoder fit for IP network.Chapter 5 summarizes the work of this thesis, and makes a forward looking on the development trend of the video product based on H.264.
引文
[1] ITU-T Prepublished Recommendation H.264, Advanced Video coding for generic audiovisual services, May 2003
[2] 郑世林主编.数码压缩技术及应用.北京:机械工业出版社,2000.
[3] 视频编码新标准H.264的技术亮点.http://www.dtv.cn/news/shownews.asp?id=616.
[4] Yao Wang,Join Ostermann,Ya-Qin Zhang.Video Processing and Communications.Prentice Hall,Inc.,2002.侯正信,杨喜,王文全等译.视频处理与通信.北京:电子工业出版社,2003.
[5] 王晓燕,郑建宏,视频压缩标准发展及MPEG-4主要技术.http://info.broadcast.sinobnet.com/HTML/001/002/013/002/45510.htm
[6] H.264历史简介.http://info.audio.hc360.com/HTML/001/002/006/13390.htm
[7] H.264标准:MPEG-4的后继者?http://www.eetchina.com/ART_8800321187_617681, 617687.HTM.0c41ea4d
[8] 李宾,高平.H.264编码系统的特点及其应用前景.电视工程.2003年.2003(6).19-21
[9] 楼剑,陆亮,虞露,董洁.H.264标准的特点及其改进研究.电视工程.2003(6).19-21
[10] News Realease. http://www.mpegla.com/news/n_03-11-17_avc.html
[11] UB Video Inc. Emerging H.264 Standard: Overview and TMS320DM642 Based Solutions for Real-Time Video Applications. Dec 2002.
[12] Iain E. G. Richardson. H.264 And MPEG-4 Video Compression. John Wiley & Sons Ltd. 2003.
[13] Iain E. G. Richardson. H.264/MPEG-4 Part 10 White Paper: Intra Prediction. http://www.vcodex.com
[14] 干宗良,李晓蕾.H.264的变换编码和量化过程分析.电视工程.2003(12).7-9
[15] Iain E, G. Richardson. H.264/MPEG-4 Part 10 White Paper: H.264 Reconstruction Filter. http://www.vcodex.com
[16] H.264 Reference Software Version JM7.3, http://iphome.hhi.de/suehrin/tml/download/ old_jm/jm86.zip.
[17] 曹文锋,张颖,张兆扬,张一钧.H.264解码器的设计与优化.电视工程. 2003(6).-16-18, 21
[18] Alex Farber. Introduction to MMX Programming. http://www.codeproject.com/cpp/mmxintro.asp
[19] Intel Corporation. Intel Architecture MMX & trade. Technology Programmers Reference Manual. Order Number 243007.
[20] Intel Corporation. Pentium Processor Family Developer's Manual. Volume 1, 2, 3. Order Number 241428, 241429, and 241430.
[21] Iain E. G. Richardson. H.264/MPEG-4 Part 10 White Paper: Transform & Quantization. http://www.vcodex.com
[22] Xiaosong Zhou, Eric Q. Li, Yen-Kuang Chen. Implementation of H.264 Decoder on Gereral-Purpose Processors with Media Instructions. SPIE Conference on Image and Video Communications and Processing, vol. 5022.2003.
[23] Intel Corp., Intel(?) VtuneTM Performance Analyzer.
[24] Jianfeng Xu, Zhibo Chen, Yun He. Efficient Fast ME Predictions and Early-termination Strategy Based on H.264 Statistical Characters. PCM2003. Singapore. Dec. 2003
[25] Zhibo Chen, et al, Hybrid Unsymmetrical Cross Multi-Hexagon-Grid Search Strategy for Integer Pel Motion Estimation in H.264. PCS 2003, France. May 2003.
[26] Ce Zhu, Xiao Lin, Lap-Pui Chau. Hexagon-Based Search Patten for Fast Block Motion Estimation. IEEE Trans. CSVT, VoL 12(5), pp349-355. May 2002
[27] Video Soft. H.264 Codec 2.0 User Manual.
[28] Foued Ben Amara, Ali Jerbi, James Au Faouzi Kossentini. Trailing artifact avoidance for low bit-rate block-based video coders. IEEE Telecommunication, Jun. 2004, pp.87-90
[29] Yao Wang, Stephan Wenger, Jiangtao Wen, and K.katsaggelos. Real Time Video Communications over Unreliable Networks. IEEE Signal Processing Magazine, Jul. 2000, pp.64-82
[30] M.Ghanbari. Video Coding: an Introduction to standard video codecs. IEE Telecommunications series: 42, 1999.
[31] T.Stockhammer, M.hannuksela, and T.Wiegand. H.264/AVC in wireless environments. IEEE Trans. Circuits Syst.Video Technol., vol. 13, pp.657-673. July 2003
[32] S.Wenger and M.horowitz. (2002) Scattered Slices: A New Error Resilience Tool for H.264. [online]. Avaliable: ftp: //ftp.imtc-files.org/jvt-experts/0202_Gen/JVT-B027.doc
[33] T.Stockhammer, T.Wiegand, T.Oelbaum and F.Obermeier. Video Coding and Transport Layer Techniques for H.264-based Transmission over Packet-lossy Networks. in Proc. ICIP 2003, Barcelona, Spain.
[34] T.Stockhammer and S.Wenger. Standard Compliant Enhancement of JVT Coded Video for Transmission Over Fixed and Wireless IP. in Proc. IWDC 2002, Capri, Italy, Sept.2002
[35] H.264/AVC Codec Software Archive..[Online]. Available: ftp: //ftp.imtc-files.org/jvt-experts/reference_software
[36] S.Wenger. (2001) Common Conditons for Wire-Line, Low Delay IP/UDP/RTP Packet Loss Resilient Testing.[Online]. Available: ftp: //ftp.imtc-files.org/jvt-experts/0109_San/VCEG-N79rl.doc
[37] VCEG. (1999) Internet Error Patterns VCEG-O38rl.doc.[Online]. Available: ftp//ftp.imtc-files.org/jvt-experts/9910_Red/Q15-I16rl.zip
[38] JVT document archives..[Online]. Available: ftp: //ftp.imtc-files.org/jvt-experts/
[39] Thomas Wiegand, Xiaozheng Zhang, and Bemd Girod. Long Term Memory Motion Compensated Prediction, IEEE Transactions on Circuits and Systems for Video Technology, Vol.9, No. 1, Feb. 1999
[40] T. Wiegand, B. Lincoln, and B.Girod, Fast search for iongterm memory motion compensated prediction, Proc. IEEE Int. Conf. Image Processing, Chicago, IL, 1998, vol. 3, pp. 619-622
[41] J.Wen and J.Villasenor. A Class of Reversible Variable Length Codes for Robust Image and Video Transmission. Presented at 1997 Asilomar Conference, Pacific Grove, CA, Nov.1997
[42] D.W.Redmill and N.G. kingsbury. The EREC: An Error Resilient Technique for Coding Variable-length Blocks of Data. IEEE Trans. Image Irocessing. vol.5, no.4, pp.565-574, Apr. 1996
[43] P.Haskell and D.Messerschmitr. Resynchronization of Motion Compensated Video Affected by ATM Cell Loss. in Proc. ICASSP-92, San Francisco, CA, vol.3 pp.545-548
[44] N.Naka. S.Adachi. M.Saigusa, and T.hoya. Improved Error Resilience in Mobile Audio-visual Communications. in Proc. IEEE Int. Conf. Universal Personal Communications, Tokyo. Japan. Nov. 1995. vol. 1, pp.702-706
[45] G.core. S.Shirani, and F.kossentini. Optimal Mode Selection and synchronization for Robust video Communications Over Error Prone Networks. IEEE J. Select. Areas Commun., vol. 18, pp.952-965, June 2000
[46] S.Wenger. Video Redundancy Coding in H.263+. in Proc. AVSPN, Aberdeen, UK, Sept. 1997
[47] S.Wenger, G.knorr, J.Ott, and F.kossentini. Error Resilience Support in H.263+. IEEE Trans. Circuit Syst. Video Technol., vol.8, no.6, pp.867-877, Nov. 1998
[48] N.Ngan and C.W.Yap. Combined Source Channel Video Coding. in Signal Recovery Techniques for Image and Video Compression and Transmission. A.K. Katsaggelos and N.P.Galatsanos, Eds. Norwell, MA: Kluwer, 1998, ch.9, pp.269-297
[49] I.Kondi, F.Ishtiaq, and A.K.katsaggelos. Joint Source-Channel Coding for Scalable Video. in Proc.2000 SPIE Conf. Visual Communications and Image Processing. San Jose. CA, Jan.2000.pp.324-335.
[50] V.A.Vaishampayan. Design of Multiple Desctription Scalar Quantizers. IEEE Trans. Inform. Theory, vol.39, pp.821-834, May 1993.
[2] 郑世林主编.数码压缩技术及应用.北京:机械工业出版社,2000.
[3] 视频编码新标准H.264的技术亮点.http://www.dtv.cn/news/shownews.asp?id=616.
[4] Yao Wang,Join Ostermann,Ya-Qin Zhang.Video Processing and Communications.Prentice Hall,Inc.,2002.侯正信,杨喜,王文全等译.视频处理与通信.北京:电子工业出版社,2003.
[5] 王晓燕,郑建宏,视频压缩标准发展及MPEG-4主要技术.http://info.broadcast.sinobnet.com/HTML/001/002/013/002/45510.htm
[6] H.264历史简介.http://info.audio.hc360.com/HTML/001/002/006/13390.htm
[7] H.264标准:MPEG-4的后继者?http://www.eetchina.com/ART_8800321187_617681, 617687.HTM.0c41ea4d
[8] 李宾,高平.H.264编码系统的特点及其应用前景.电视工程.2003年.2003(6).19-21
[9] 楼剑,陆亮,虞露,董洁.H.264标准的特点及其改进研究.电视工程.2003(6).19-21
[10] News Realease. http://www.mpegla.com/news/n_03-11-17_avc.html
[11] UB Video Inc. Emerging H.264 Standard: Overview and TMS320DM642 Based Solutions for Real-Time Video Applications. Dec 2002.
[12] Iain E. G. Richardson. H.264 And MPEG-4 Video Compression. John Wiley & Sons Ltd. 2003.
[13] Iain E. G. Richardson. H.264/MPEG-4 Part 10 White Paper: Intra Prediction. http://www.vcodex.com
[14] 干宗良,李晓蕾.H.264的变换编码和量化过程分析.电视工程.2003(12).7-9
[15] Iain E, G. Richardson. H.264/MPEG-4 Part 10 White Paper: H.264 Reconstruction Filter. http://www.vcodex.com
[16] H.264 Reference Software Version JM7.3, http://iphome.hhi.de/suehrin/tml/download/ old_jm/jm86.zip.
[17] 曹文锋,张颖,张兆扬,张一钧.H.264解码器的设计与优化.电视工程. 2003(6).-16-18, 21
[18] Alex Farber. Introduction to MMX Programming. http://www.codeproject.com/cpp/mmxintro.asp
[19] Intel Corporation. Intel Architecture MMX & trade. Technology Programmers Reference Manual. Order Number 243007.
[20] Intel Corporation. Pentium Processor Family Developer's Manual. Volume 1, 2, 3. Order Number 241428, 241429, and 241430.
[21] Iain E. G. Richardson. H.264/MPEG-4 Part 10 White Paper: Transform & Quantization. http://www.vcodex.com
[22] Xiaosong Zhou, Eric Q. Li, Yen-Kuang Chen. Implementation of H.264 Decoder on Gereral-Purpose Processors with Media Instructions. SPIE Conference on Image and Video Communications and Processing, vol. 5022.2003.
[23] Intel Corp., Intel(?) VtuneTM Performance Analyzer.
[24] Jianfeng Xu, Zhibo Chen, Yun He. Efficient Fast ME Predictions and Early-termination Strategy Based on H.264 Statistical Characters. PCM2003. Singapore. Dec. 2003
[25] Zhibo Chen, et al, Hybrid Unsymmetrical Cross Multi-Hexagon-Grid Search Strategy for Integer Pel Motion Estimation in H.264. PCS 2003, France. May 2003.
[26] Ce Zhu, Xiao Lin, Lap-Pui Chau. Hexagon-Based Search Patten for Fast Block Motion Estimation. IEEE Trans. CSVT, VoL 12(5), pp349-355. May 2002
[27] Video Soft. H.264 Codec 2.0 User Manual.
[28] Foued Ben Amara, Ali Jerbi, James Au Faouzi Kossentini. Trailing artifact avoidance for low bit-rate block-based video coders. IEEE Telecommunication, Jun. 2004, pp.87-90
[29] Yao Wang, Stephan Wenger, Jiangtao Wen, and K.katsaggelos. Real Time Video Communications over Unreliable Networks. IEEE Signal Processing Magazine, Jul. 2000, pp.64-82
[30] M.Ghanbari. Video Coding: an Introduction to standard video codecs. IEE Telecommunications series: 42, 1999.
[31] T.Stockhammer, M.hannuksela, and T.Wiegand. H.264/AVC in wireless environments. IEEE Trans. Circuits Syst.Video Technol., vol. 13, pp.657-673. July 2003
[32] S.Wenger and M.horowitz. (2002) Scattered Slices: A New Error Resilience Tool for H.264. [online]. Avaliable: ftp: //ftp.imtc-files.org/jvt-experts/0202_Gen/JVT-B027.doc
[33] T.Stockhammer, T.Wiegand, T.Oelbaum and F.Obermeier. Video Coding and Transport Layer Techniques for H.264-based Transmission over Packet-lossy Networks. in Proc. ICIP 2003, Barcelona, Spain.
[34] T.Stockhammer and S.Wenger. Standard Compliant Enhancement of JVT Coded Video for Transmission Over Fixed and Wireless IP. in Proc. IWDC 2002, Capri, Italy, Sept.2002
[35] H.264/AVC Codec Software Archive..[Online]. Available: ftp: //ftp.imtc-files.org/jvt-experts/reference_software
[36] S.Wenger. (2001) Common Conditons for Wire-Line, Low Delay IP/UDP/RTP Packet Loss Resilient Testing.[Online]. Available: ftp: //ftp.imtc-files.org/jvt-experts/0109_San/VCEG-N79rl.doc
[37] VCEG. (1999) Internet Error Patterns VCEG-O38rl.doc.[Online]. Available: ftp//ftp.imtc-files.org/jvt-experts/9910_Red/Q15-I16rl.zip
[38] JVT document archives..[Online]. Available: ftp: //ftp.imtc-files.org/jvt-experts/
[39] Thomas Wiegand, Xiaozheng Zhang, and Bemd Girod. Long Term Memory Motion Compensated Prediction, IEEE Transactions on Circuits and Systems for Video Technology, Vol.9, No. 1, Feb. 1999
[40] T. Wiegand, B. Lincoln, and B.Girod, Fast search for iongterm memory motion compensated prediction, Proc. IEEE Int. Conf. Image Processing, Chicago, IL, 1998, vol. 3, pp. 619-622
[41] J.Wen and J.Villasenor. A Class of Reversible Variable Length Codes for Robust Image and Video Transmission. Presented at 1997 Asilomar Conference, Pacific Grove, CA, Nov.1997
[42] D.W.Redmill and N.G. kingsbury. The EREC: An Error Resilient Technique for Coding Variable-length Blocks of Data. IEEE Trans. Image Irocessing. vol.5, no.4, pp.565-574, Apr. 1996
[43] P.Haskell and D.Messerschmitr. Resynchronization of Motion Compensated Video Affected by ATM Cell Loss. in Proc. ICASSP-92, San Francisco, CA, vol.3 pp.545-548
[44] N.Naka. S.Adachi. M.Saigusa, and T.hoya. Improved Error Resilience in Mobile Audio-visual Communications. in Proc. IEEE Int. Conf. Universal Personal Communications, Tokyo. Japan. Nov. 1995. vol. 1, pp.702-706
[45] G.core. S.Shirani, and F.kossentini. Optimal Mode Selection and synchronization for Robust video Communications Over Error Prone Networks. IEEE J. Select. Areas Commun., vol. 18, pp.952-965, June 2000
[46] S.Wenger. Video Redundancy Coding in H.263+. in Proc. AVSPN, Aberdeen, UK, Sept. 1997
[47] S.Wenger, G.knorr, J.Ott, and F.kossentini. Error Resilience Support in H.263+. IEEE Trans. Circuit Syst. Video Technol., vol.8, no.6, pp.867-877, Nov. 1998
[48] N.Ngan and C.W.Yap. Combined Source Channel Video Coding. in Signal Recovery Techniques for Image and Video Compression and Transmission. A.K. Katsaggelos and N.P.Galatsanos, Eds. Norwell, MA: Kluwer, 1998, ch.9, pp.269-297
[49] I.Kondi, F.Ishtiaq, and A.K.katsaggelos. Joint Source-Channel Coding for Scalable Video. in Proc.2000 SPIE Conf. Visual Communications and Image Processing. San Jose. CA, Jan.2000.pp.324-335.
[50] V.A.Vaishampayan. Design of Multiple Desctription Scalar Quantizers. IEEE Trans. Inform. Theory, vol.39, pp.821-834, May 1993.