基于DM642的MPEG4算法的移植和优化
摘要
随着多媒体信息需求的增长,在低速信道上实现实时动态视频编解码技术是目前视频处理领域的一个研究热点,嵌入式视频编解码技术有着越来越广泛的应用前景。本文实现了基于DM642的MPEG4嵌入式视频压缩系统,可应用于需要数据压缩的嵌入式多媒体领域。
本文首先深入研究了DM642的硬件特性,包括处理器结构,视频口外设、存储器结构、并行硬件结构、集成开发环境CCS和DSP/BIOS的配置和使用方法,并分析了优化时可以利用到的所有硬件特性。针对视频压缩,重点研究了MPEG4算法的框架和流程、算法的各个组成模块、视频口的结构和视频采集功能的实现原理,为算法的移植奠定基础;其次,作为本文的重点,深入分析了算法移植中遇到的问题,并针对具体问题设计了优化中采用的各种方法,分模块逐一进行优化、针对每一种优化方法,测试了优化前后的性能并进行对比,同时列出了按一定流程进行优化后的性能测试总结。
本文采用调整程序结构、存储器优化、流水线技术、线性汇编、内联函数、自带函数库等优化方法对移植成功的MPEG4 C语言程序进行优化。经测试,本系统优化前为2秒一帧,经优化后达到了CIF格式16帧每秒的压缩任务,基本满足了视频监控系统的需求。
With the increasing demand on Multimedia information, It is a hot research area where implement real-time and live video coding on low speed transmission channel. Main harvest of this paper was that it introduced a MPEG4 embedded video compression system which would be normally used in embedded multimedia area who request video compression.
First of all, this paper introduced hardware characteristic of DM642 which included the structure of the CPU and memory, video peripheric, the parallel hardware structure, and configuration and application of CCS and DSP/BIOS, and made a analysis of the hardware traits which was favor to optimization. Aiming at video compression, highlight of this part was focused on the process of implementing video capture and the principle and utility of video driver, this all made a basis for next job. In the second part of this paper, it covered the frame and flow of MPEG4 algorithm, and specially enhanced the modules which composed the algorithm. The last part, as the center of this paper, gave a detailed description of the obstacles encountered when transplanted and the methods used when optimization, and gave the comparison of every mothods that was been employed between the front and after condition of the optimization. Meanwhile, it demonstrated a performance-tesing summary that was arranged by the flow of optimization.
After some optimization methods such as adjusting program structure and memory, pipeline technology, linear assembly, inline function and Image Library. After tset, it reflected a fact that the system completed a CIF format compression task of 15 frames per second compared with the previous 2 second per frame and basiclly satisfied video monitor system.
本文首先深入研究了DM642的硬件特性,包括处理器结构,视频口外设、存储器结构、并行硬件结构、集成开发环境CCS和DSP/BIOS的配置和使用方法,并分析了优化时可以利用到的所有硬件特性。针对视频压缩,重点研究了MPEG4算法的框架和流程、算法的各个组成模块、视频口的结构和视频采集功能的实现原理,为算法的移植奠定基础;其次,作为本文的重点,深入分析了算法移植中遇到的问题,并针对具体问题设计了优化中采用的各种方法,分模块逐一进行优化、针对每一种优化方法,测试了优化前后的性能并进行对比,同时列出了按一定流程进行优化后的性能测试总结。
本文采用调整程序结构、存储器优化、流水线技术、线性汇编、内联函数、自带函数库等优化方法对移植成功的MPEG4 C语言程序进行优化。经测试,本系统优化前为2秒一帧,经优化后达到了CIF格式16帧每秒的压缩任务,基本满足了视频监控系统的需求。
With the increasing demand on Multimedia information, It is a hot research area where implement real-time and live video coding on low speed transmission channel. Main harvest of this paper was that it introduced a MPEG4 embedded video compression system which would be normally used in embedded multimedia area who request video compression.
First of all, this paper introduced hardware characteristic of DM642 which included the structure of the CPU and memory, video peripheric, the parallel hardware structure, and configuration and application of CCS and DSP/BIOS, and made a analysis of the hardware traits which was favor to optimization. Aiming at video compression, highlight of this part was focused on the process of implementing video capture and the principle and utility of video driver, this all made a basis for next job. In the second part of this paper, it covered the frame and flow of MPEG4 algorithm, and specially enhanced the modules which composed the algorithm. The last part, as the center of this paper, gave a detailed description of the obstacles encountered when transplanted and the methods used when optimization, and gave the comparison of every mothods that was been employed between the front and after condition of the optimization. Meanwhile, it demonstrated a performance-tesing summary that was arranged by the flow of optimization.
After some optimization methods such as adjusting program structure and memory, pipeline technology, linear assembly, inline function and Image Library. After tset, it reflected a fact that the system completed a CIF format compression task of 15 frames per second compared with the previous 2 second per frame and basiclly satisfied video monitor system.
引文
[1] A.M.Tekalp."Digital Video Processing", EnglewoodClifs: Printice Hall, 1995.
[2] S.J.WeeandJ.G.A postolopoulos. "Efficient Processing of Compressed Video",Conference Record of the thirty-second Asilomar Conference on Signals, Systems&Computers, 1998(1): 853-857.
[3] C.C.Culter."Differential quantizations of communication systems", U.S.Patent2605361, Jul.1952.
[4] J.B.O’Neal."A bound on signal-to-quantizing noise ratios for digital encoding systems", Proceedings of the IEEE, Volume55, Issue3, Mar.1967, Pp: 287-292.
[5] B.G.Haskell, F.W.Mounts and J.C.Candy. "Interframe coding of videotelephone pictures", Proceedings of the IEEE, Volume60, ssue7, Jul.1972, Pp: 792-800.
[6] K.R.Rao."Predictive Coding Based On Efficient MotionEstimation", IEEE Trans.Commun, 1985, 33(8): 888-896.
[7] H.Andrewsand W. Prat. "Entropy considerations in the frequency domain", Proceedings of the IEEE, Vol. 56, Issue1, Jan.1968, Pp: 113-114.
[8] D.A.Huffman."A method for the construction of minimum-redundancy codes", Proceedings of the IRE, Volume 40, Number9, 1952, Pp: 1098-1101.
[9] Witten, R.Neal and J.Cleary. "Arithmetic Coding for Data Compression", Communication ACM, 1987, 30(6):520-540.
[10] J.M.Shapiro, "Embedded Image Coding using Zerotrees of Wavelet Coeficients", IEEE Transactions on Signal Processing, Vol.41, No.1, 1993, Pp: 3445-3462.
[11] D.E.Pearson."Developments in Model-Based Video Coding", Proceedings of the IEEE, 1995, 83(6): 892-906.
[12] ITU-T Recommendation H.261, "Video Codec for Audiovisual Servicesat64kbit/s", in Proc.COM 15R 16-E, Mar.1993.
[13] ISO-IEC CD11172, "Coding of Moving Pictures and Associated Audio forDigital Storage Media at up to 1.5Mbits/sec -Part2: Coding of Moving Pictures Information", Dec.1991.
[14] ISO-IEC 13318-2, "Information Technology Coding of Moving Pictures andAssociated Audio Part2: Video", 1995.
[15] ITU-U Draft H.263, "Video Coding for Low Bit rate Communication", May.1996.
[16] ISO/IEC FDIS 14496-2, "Information Technology-Generic Coding of Audio-visual Objects Part2: Visual", Oct.1998.
[17] ITU-T Recommendation H.264,"Advanced Video Coding", Oct.2002.
[18]先进音视频编码标准(AVS)报批稿.
[19]孙景琪编著.视频技术与应用电视原理、遙控系统、电视广播系统.北京:北京工业大学出版社.2003.
[20] TMS320C6000 DSP Cache User's Guide. 2003, Texas Instruments Incorporated.
[21] TechnicalOverview:DSP Video and Imaging Digital Applications.Sep.2002,Texas Instruments Incorporated.
[22] TMS320C64x DSP Video PortVCXO Interpolated Control (VIC) Port Reference Guide. June 2007. Texas Instruments Incorporated.
[23] TMS320C6000 DSP/BIOSUser’s Guide. May2000. Texas Instruments Incorporated.
[24] http://www.52video.net/art_view1304.html.
[25]邱钢.运用定点DSP实现MPEG4标准中DCT系数快速量化的方法. http://www.semiapps.com.cn/content.php?content_id=70325045900599972&node_id=272.
[26] http://www.dgwxx.net/blog/blog_35.html.
[27] TMS320C6000 Programmer’sGuide.Oct.2002.TexasInstruments Incorporated.
[28] TMS320C6000 Optimizing Compiler v6.1 User's Guide. Oct 2002.Texas Instruments Incorporated.
[2] S.J.WeeandJ.G.A postolopoulos. "Efficient Processing of Compressed Video",Conference Record of the thirty-second Asilomar Conference on Signals, Systems&Computers, 1998(1): 853-857.
[3] C.C.Culter."Differential quantizations of communication systems", U.S.Patent2605361, Jul.1952.
[4] J.B.O’Neal."A bound on signal-to-quantizing noise ratios for digital encoding systems", Proceedings of the IEEE, Volume55, Issue3, Mar.1967, Pp: 287-292.
[5] B.G.Haskell, F.W.Mounts and J.C.Candy. "Interframe coding of videotelephone pictures", Proceedings of the IEEE, Volume60, ssue7, Jul.1972, Pp: 792-800.
[6] K.R.Rao."Predictive Coding Based On Efficient MotionEstimation", IEEE Trans.Commun, 1985, 33(8): 888-896.
[7] H.Andrewsand W. Prat. "Entropy considerations in the frequency domain", Proceedings of the IEEE, Vol. 56, Issue1, Jan.1968, Pp: 113-114.
[8] D.A.Huffman."A method for the construction of minimum-redundancy codes", Proceedings of the IRE, Volume 40, Number9, 1952, Pp: 1098-1101.
[9] Witten, R.Neal and J.Cleary. "Arithmetic Coding for Data Compression", Communication ACM, 1987, 30(6):520-540.
[10] J.M.Shapiro, "Embedded Image Coding using Zerotrees of Wavelet Coeficients", IEEE Transactions on Signal Processing, Vol.41, No.1, 1993, Pp: 3445-3462.
[11] D.E.Pearson."Developments in Model-Based Video Coding", Proceedings of the IEEE, 1995, 83(6): 892-906.
[12] ITU-T Recommendation H.261, "Video Codec for Audiovisual Servicesat64kbit/s", in Proc.COM 15R 16-E, Mar.1993.
[13] ISO-IEC CD11172, "Coding of Moving Pictures and Associated Audio forDigital Storage Media at up to 1.5Mbits/sec -Part2: Coding of Moving Pictures Information", Dec.1991.
[14] ISO-IEC 13318-2, "Information Technology Coding of Moving Pictures andAssociated Audio Part2: Video", 1995.
[15] ITU-U Draft H.263, "Video Coding for Low Bit rate Communication", May.1996.
[16] ISO/IEC FDIS 14496-2, "Information Technology-Generic Coding of Audio-visual Objects Part2: Visual", Oct.1998.
[17] ITU-T Recommendation H.264,"Advanced Video Coding", Oct.2002.
[18]先进音视频编码标准(AVS)报批稿.
[19]孙景琪编著.视频技术与应用电视原理、遙控系统、电视广播系统.北京:北京工业大学出版社.2003.
[20] TMS320C6000 DSP Cache User's Guide. 2003, Texas Instruments Incorporated.
[21] TechnicalOverview:DSP Video and Imaging Digital Applications.Sep.2002,Texas Instruments Incorporated.
[22] TMS320C64x DSP Video PortVCXO Interpolated Control (VIC) Port Reference Guide. June 2007. Texas Instruments Incorporated.
[23] TMS320C6000 DSP/BIOSUser’s Guide. May2000. Texas Instruments Incorporated.
[24] http://www.52video.net/art_view1304.html.
[25]邱钢.运用定点DSP实现MPEG4标准中DCT系数快速量化的方法. http://www.semiapps.com.cn/content.php?content_id=70325045900599972&node_id=272.
[26] http://www.dgwxx.net/blog/blog_35.html.
[27] TMS320C6000 Programmer’sGuide.Oct.2002.TexasInstruments Incorporated.
[28] TMS320C6000 Optimizing Compiler v6.1 User's Guide. Oct 2002.Texas Instruments Incorporated.