基于DSP平台的视频采集系统与MPEG-2视频压缩算法研究
|
摘要
近年来,随着DSP技术的高速发展,使得视频处理技术取得了长足的进步,而以DSP为核心的视频处理系统也就得到了广泛的应用。本文在深入研究DSP的技术和理论后,设计了一种基于DSP的视频图像处理系统,该系统的研究主要基于DSP芯片体积小、处理速度快、实时性高、价格低廉等特点。
目前的图像处理多借助于图像卡和微机系统的高处理速度和大存储容量来完成对图像的相关处理工作,但带来了体积大、成本高、工作稳定性差等缺点。本文在研究了DSP的特性后,选用TI公司高性能的C6000系列DSP,并确定了系统各组成部分的设计方案,对系统各组成模块的功能和特点作了详细的介绍。
整个系统设计包括硬件设计和软件设计两大部分,在系统硬件设计中给出了视频采集子卡的硬件接口方案;在软件设计部分设计了对应于硬件接口的底层软件并对MPEG-2算法进行了深入研究。TMS320C6711是TI公司推出的一款高性能浮点数字信号处理器,它强大的硬件结构和软件系统,以及高达200MHz的运算速度,使其在本系统中得以采用,它主要完成对图像的处理。视频采集模块采用的是MICRON公司2004年生产的一款300万像素(2048×1536)CMOS彩色图像传感器,它采用Digital Clarity Image Sensor Technology技术,使得它有43dB的信噪比、可广泛应用于视频会议、数码相机、摄象机等众多领域。为了提高系统的集成度和可扩展性,从而达到小型化的目的,本系统采用CPLD器件来完成整个系统的逻辑控制功能。考虑系统所需CPLD器件控制的输入输出管脚数量和内部逻辑资源使用的情况,选用ALTERA公司的CPLD芯片EPM240作为系统的逻辑控制器件。
本论文的软件部分简述了视频压缩标准的概况和MPEG-2标准的主要部分(系统部分,视频部分)。阐述了视频压缩原理与MPEG视频压缩算法:离散余弦变换(DCT )、量化编码与行程幅度编码。对视频流与系统流的语法构造以及视频的解码过程:可变长解码、反向扫描、反量化、反向离散余弦变换(IDCT)和运动补偿进行了较为详细的分析和阐述。
本文通过实验研究,设计了一种应用于图像采集的子卡硬件方案,为基于数字信号处理器的MPEG-2视频编解码算法提供了实验依据,具有一定的实用价值。
In recent years, DSP technology with the rapid development, Makes video processing technology has made remarkable progress. DSP core video processing system will be widely used. Based on the in-depth study of DSP technologies and theories, this article designed a DSP-based video image processing system. The system is mainly based on small size, fast processing speed, real-time and low price of DSP’s characteristics .
The current image processing usually depends on the high processing speed and large storage capacity of image card and PC to complete the image processing, but while brings a large volume, high cost and poor stability. This paper studied the characteristics of DSP, selected TI's high-performance C6000 DSP, and identified the various components of the system design. The components of the system module functions and features are described in detail.
Design of the entire system, includes hardware and software design. In the hardware design the hardware interface program of Video Capture Daughter Card was made certain. In software design the software corresponding to the hardware interface was designed and the algorithm for MPEG-2 was as well as an in-depth study. TMS320C6711 is a high-performance floating-point digital signal processor produced by TI company. It has powerful hardware and software systems, and the high computational speed of 200MHz , so this chip is used in this article. It mainly completes image processing. Video Capture Module used one of the three million pixels (2048×1536) CMOS color image sensor produced by MICRON company in the year of 2004. It uses Digital Clarity Image Sensor Technology, and makes the signal-to-noise ratio is 43dB. It can be widely used in video conferencing, digital camera, video camera and many other fields. In order to improve the integration and scalability, so as to achieve the objective of the small, the system uses CPLD to accomplish the whole system control logic functions. Consider CPLD system for the control of the number of input and output pins and internal logic of the use of resources, this paper chose Altera EPM240 CPLD logic as a system of control device.
This paper described the software video compression standard and the main port of MPEG-2 standard (system, Video), and expounded the principle of video compression and MPEG video compression algorithm: Discrete Cosine Transform (DCT), quantify the rate coding. Video on stream flow and the syntax and structure of the video decoding processing is: Variable length decoder, reverse scanning, anti - quantization, inverse discrete cosine transform (IDCT) and Motion Compensation, for a more detailed analysis and exposition.
By experimental study, a design is applied to the image-acquisition hardware card program. For digital signal processors based on the MPEG-2 video codec algorithm provides experimental evidence, this paper has some practical value.
目前的图像处理多借助于图像卡和微机系统的高处理速度和大存储容量来完成对图像的相关处理工作,但带来了体积大、成本高、工作稳定性差等缺点。本文在研究了DSP的特性后,选用TI公司高性能的C6000系列DSP,并确定了系统各组成部分的设计方案,对系统各组成模块的功能和特点作了详细的介绍。
整个系统设计包括硬件设计和软件设计两大部分,在系统硬件设计中给出了视频采集子卡的硬件接口方案;在软件设计部分设计了对应于硬件接口的底层软件并对MPEG-2算法进行了深入研究。TMS320C6711是TI公司推出的一款高性能浮点数字信号处理器,它强大的硬件结构和软件系统,以及高达200MHz的运算速度,使其在本系统中得以采用,它主要完成对图像的处理。视频采集模块采用的是MICRON公司2004年生产的一款300万像素(2048×1536)CMOS彩色图像传感器,它采用Digital Clarity Image Sensor Technology技术,使得它有43dB的信噪比、可广泛应用于视频会议、数码相机、摄象机等众多领域。为了提高系统的集成度和可扩展性,从而达到小型化的目的,本系统采用CPLD器件来完成整个系统的逻辑控制功能。考虑系统所需CPLD器件控制的输入输出管脚数量和内部逻辑资源使用的情况,选用ALTERA公司的CPLD芯片EPM240作为系统的逻辑控制器件。
本论文的软件部分简述了视频压缩标准的概况和MPEG-2标准的主要部分(系统部分,视频部分)。阐述了视频压缩原理与MPEG视频压缩算法:离散余弦变换(DCT )、量化编码与行程幅度编码。对视频流与系统流的语法构造以及视频的解码过程:可变长解码、反向扫描、反量化、反向离散余弦变换(IDCT)和运动补偿进行了较为详细的分析和阐述。
本文通过实验研究,设计了一种应用于图像采集的子卡硬件方案,为基于数字信号处理器的MPEG-2视频编解码算法提供了实验依据,具有一定的实用价值。
In recent years, DSP technology with the rapid development, Makes video processing technology has made remarkable progress. DSP core video processing system will be widely used. Based on the in-depth study of DSP technologies and theories, this article designed a DSP-based video image processing system. The system is mainly based on small size, fast processing speed, real-time and low price of DSP’s characteristics .
The current image processing usually depends on the high processing speed and large storage capacity of image card and PC to complete the image processing, but while brings a large volume, high cost and poor stability. This paper studied the characteristics of DSP, selected TI's high-performance C6000 DSP, and identified the various components of the system design. The components of the system module functions and features are described in detail.
Design of the entire system, includes hardware and software design. In the hardware design the hardware interface program of Video Capture Daughter Card was made certain. In software design the software corresponding to the hardware interface was designed and the algorithm for MPEG-2 was as well as an in-depth study. TMS320C6711 is a high-performance floating-point digital signal processor produced by TI company. It has powerful hardware and software systems, and the high computational speed of 200MHz , so this chip is used in this article. It mainly completes image processing. Video Capture Module used one of the three million pixels (2048×1536) CMOS color image sensor produced by MICRON company in the year of 2004. It uses Digital Clarity Image Sensor Technology, and makes the signal-to-noise ratio is 43dB. It can be widely used in video conferencing, digital camera, video camera and many other fields. In order to improve the integration and scalability, so as to achieve the objective of the small, the system uses CPLD to accomplish the whole system control logic functions. Consider CPLD system for the control of the number of input and output pins and internal logic of the use of resources, this paper chose Altera EPM240 CPLD logic as a system of control device.
This paper described the software video compression standard and the main port of MPEG-2 standard (system, Video), and expounded the principle of video compression and MPEG video compression algorithm: Discrete Cosine Transform (DCT), quantify the rate coding. Video on stream flow and the syntax and structure of the video decoding processing is: Variable length decoder, reverse scanning, anti - quantization, inverse discrete cosine transform (IDCT) and Motion Compensation, for a more detailed analysis and exposition.
By experimental study, a design is applied to the image-acquisition hardware card program. For digital signal processors based on the MPEG-2 video codec algorithm provides experimental evidence, this paper has some practical value.
引文
[1] 丁宗豪,曾国良. 图像压缩编码标准 MPEG-2 的图像格式. 电视技术,1995
[2] 张春田. 视频信号压缩编码. 广播与电视技术,1995
[3] N. Kehtarnavaz and M. Keramat, DSP System Design Using the TMS320C6000, Prentice Hall, Upper Saddle River, 2001
[4] 李方慧. TMS320C6000 系列 DSPs 原理与应用(第 2 版) . 电子工业出版社,2003
[5] 王念旭. DSP 基础与应用系统设计. 北京航空航天大学出版社. 2001
[6] 叶明译.JPEG/MPEG2 技术.科学出版社,2004
[7] 王汇源编著.数字图像通信原理与技术.国防工业出版社,2000
[8] 姚庆栋等.图像编码基础.人民邮电出版社,1994
[9] G ibson,J,D 李煌等译. 多媒体数字压缩原理与标准. 电子工业出版社,2000
[10] 苏光大. 微机图像处理系统. 清华大学出版社,2000
[11] 康勇诗. MPEG 与 MPEG-2 标准. 广播与电视技术,1995
[12] 张雄伟编著.DSP 芯片的原理与应用.电子工业出版社,1997
[13] 黄风英主编.DSP 原理与应用.东南大学出版社,1997
[14] TMS320C6711 Floating-point Digital Signal Processor, Texas Instruments, 2000
[15] W. J. Gomes III and R. Chassaing, Filter design and implementation using the TMS320C6x interfaced with MATLAB, Proseedings of the 2000 ASEE Annual Conference, 2000
[16] TMS320C6000 CPU and Instruction Set Reference Guide, Texas Instruments, 2000
[17] TMS320C6000 Perpherals Reference Guide, Texas Instruments, 2001
[18] MT9T001 3-MEGAPIXEL DIGITAL IMAGE SENSOR, Micron Technology. Inc , 2003
[19] 袁子健,吴志敏,高举. 高速 PCB 的过孔设计. 电子工艺技术,2002
[20] 曾峰,候亚,宁曾,凡雨. 印刷电路板的设计与制作. 电子工业出版社,2002
[21] ISO/IECJCT1/SC29 CD13818-2:MPEG2, coding of moving pictures and associated audio,1993
[22] 张贤达.现代数字信号处理.清华大学出版社,1995
[23] Gall D l.MPEG: A video compression standard for multimedia applicatons. Communications of the ACM, 1991
[24] Jain A K.Fundamentals of Digital Image Processing. Englewood Cliffs, 1989
[25] 胡广书编著.数字信号处理理论、算法与实现.清华大学出版社,1997
[26] 徐盛,胡剑凌编译.TMS320 DSP 标准算法.清华大学出版社,2007
[27] 陈禾等.DCT 快速算法及其 VLSI 实现.信号处理,1998
[28] 张益贞 刘滔编. Visual C++实现数字 JPEG/MPEG 编解码技术. 人民邮电出版社,2002
[29] Alexandros Eleftheriadis, Carsten Herpel, Ganesh Rajan, Text for ISO/IEC FCD14496-1 Systems, 1998
[30] 程佩青.数字信号处理教程.清华大学出版社,2001
[31] 郭玮,姚林泉,张延华.数字信号处理.机械工业出版社,2005
[32] Mitra, Sanjit Kumar. Digital signal processing. Publishing company of Qing hua University. 2001
[33] 朱秀昌,刘峰,胡栋. 数字图像处理与图像通信. 北京邮电大学出版社,2002
[34] Tekalp A M, Digital Video Processing. Upper Saddle River, NJ: Prentice Hall PTR, 1995
[35] Rafael C. Gonzalez Richard E. Woods 阮秋琦 阮宇智译. 数字图像处理. 电子工业出版社,2003
[36] 郝杰 吴元清 郑榕. 实用多媒体技术及其 C 语言实现. 北京:电子工业出版社,1995
[37] 张晓飞 袁祥辉. 基于 DSP 成像系统的视频图像采集部分的实现. 压电与声光 ,2002
[38] 邹鲲,袁俊泉,万小朋. MATLAB6.x 信号处理.第 1 版.北京:清华大学出版社.2002
[39] 白义臣,罗勇江,罗军辉.MATLAB 7.0 在数字信号处理中的应用.机械出版社.2005
[40] 王军宁等编译. TI DSP/BIOS 用户手册与驱动开发.清华大学出版社,2007
[41] 刘宝琴等.ALTERA 可编程逻辑器件及其应用.清华大学出版社,1995
[42] 王小军编.VHDL 简明教程.清华大学出版社,1997
[43] 侯伯享,顾新编著.VHDL 硬件描述语言与数字逻辑电路设计—电子工程师必备知识.西安电子科技大学出版社,1999
[44] 胡晓飞,殳国华,张士文. 基于视频处理芯片和 CPLD 的实时图像采集系统. 电子技术,2002
[45] 姚志强,尹俊勋,熊日辉. 基于 DSP 与 CPLD 的 I2C 总线接口的设计与实现. 电子技术应用,2004
[46] TMS320C6000 Programmer’s Guide, Texas Instruments, 2000
[47] TMS320C6000 Assembly Language Tools User’s Guide, Texas Instruments, 2000
[48] TMS320C6000 Optimizing Compiler User’s Guide, Texas Instruments, 2000
[49] Code Composer Studio Getting Started Guide, Texas Instruments, 2001
[50] 田元,叶秀清,顾伟康. 实时图像处理系统中的优化编程. 电子技术应用,2000
[2] 张春田. 视频信号压缩编码. 广播与电视技术,1995
[3] N. Kehtarnavaz and M. Keramat, DSP System Design Using the TMS320C6000, Prentice Hall, Upper Saddle River, 2001
[4] 李方慧. TMS320C6000 系列 DSPs 原理与应用(第 2 版) . 电子工业出版社,2003
[5] 王念旭. DSP 基础与应用系统设计. 北京航空航天大学出版社. 2001
[6] 叶明译.JPEG/MPEG2 技术.科学出版社,2004
[7] 王汇源编著.数字图像通信原理与技术.国防工业出版社,2000
[8] 姚庆栋等.图像编码基础.人民邮电出版社,1994
[9] G ibson,J,D 李煌等译. 多媒体数字压缩原理与标准. 电子工业出版社,2000
[10] 苏光大. 微机图像处理系统. 清华大学出版社,2000
[11] 康勇诗. MPEG 与 MPEG-2 标准. 广播与电视技术,1995
[12] 张雄伟编著.DSP 芯片的原理与应用.电子工业出版社,1997
[13] 黄风英主编.DSP 原理与应用.东南大学出版社,1997
[14] TMS320C6711 Floating-point Digital Signal Processor, Texas Instruments, 2000
[15] W. J. Gomes III and R. Chassaing, Filter design and implementation using the TMS320C6x interfaced with MATLAB, Proseedings of the 2000 ASEE Annual Conference, 2000
[16] TMS320C6000 CPU and Instruction Set Reference Guide, Texas Instruments, 2000
[17] TMS320C6000 Perpherals Reference Guide, Texas Instruments, 2001
[18] MT9T001 3-MEGAPIXEL DIGITAL IMAGE SENSOR, Micron Technology. Inc , 2003
[19] 袁子健,吴志敏,高举. 高速 PCB 的过孔设计. 电子工艺技术,2002
[20] 曾峰,候亚,宁曾,凡雨. 印刷电路板的设计与制作. 电子工业出版社,2002
[21] ISO/IECJCT1/SC29 CD13818-2:MPEG2, coding of moving pictures and associated audio,1993
[22] 张贤达.现代数字信号处理.清华大学出版社,1995
[23] Gall D l.MPEG: A video compression standard for multimedia applicatons. Communications of the ACM, 1991
[24] Jain A K.Fundamentals of Digital Image Processing. Englewood Cliffs, 1989
[25] 胡广书编著.数字信号处理理论、算法与实现.清华大学出版社,1997
[26] 徐盛,胡剑凌编译.TMS320 DSP 标准算法.清华大学出版社,2007
[27] 陈禾等.DCT 快速算法及其 VLSI 实现.信号处理,1998
[28] 张益贞 刘滔编. Visual C++实现数字 JPEG/MPEG 编解码技术. 人民邮电出版社,2002
[29] Alexandros Eleftheriadis, Carsten Herpel, Ganesh Rajan, Text for ISO/IEC FCD14496-1 Systems, 1998
[30] 程佩青.数字信号处理教程.清华大学出版社,2001
[31] 郭玮,姚林泉,张延华.数字信号处理.机械工业出版社,2005
[32] Mitra, Sanjit Kumar. Digital signal processing. Publishing company of Qing hua University. 2001
[33] 朱秀昌,刘峰,胡栋. 数字图像处理与图像通信. 北京邮电大学出版社,2002
[34] Tekalp A M, Digital Video Processing. Upper Saddle River, NJ: Prentice Hall PTR, 1995
[35] Rafael C. Gonzalez Richard E. Woods 阮秋琦 阮宇智译. 数字图像处理. 电子工业出版社,2003
[36] 郝杰 吴元清 郑榕. 实用多媒体技术及其 C 语言实现. 北京:电子工业出版社,1995
[37] 张晓飞 袁祥辉. 基于 DSP 成像系统的视频图像采集部分的实现. 压电与声光 ,2002
[38] 邹鲲,袁俊泉,万小朋. MATLAB6.x 信号处理.第 1 版.北京:清华大学出版社.2002
[39] 白义臣,罗勇江,罗军辉.MATLAB 7.0 在数字信号处理中的应用.机械出版社.2005
[40] 王军宁等编译. TI DSP/BIOS 用户手册与驱动开发.清华大学出版社,2007
[41] 刘宝琴等.ALTERA 可编程逻辑器件及其应用.清华大学出版社,1995
[42] 王小军编.VHDL 简明教程.清华大学出版社,1997
[43] 侯伯享,顾新编著.VHDL 硬件描述语言与数字逻辑电路设计—电子工程师必备知识.西安电子科技大学出版社,1999
[44] 胡晓飞,殳国华,张士文. 基于视频处理芯片和 CPLD 的实时图像采集系统. 电子技术,2002
[45] 姚志强,尹俊勋,熊日辉. 基于 DSP 与 CPLD 的 I2C 总线接口的设计与实现. 电子技术应用,2004
[46] TMS320C6000 Programmer’s Guide, Texas Instruments, 2000
[47] TMS320C6000 Assembly Language Tools User’s Guide, Texas Instruments, 2000
[48] TMS320C6000 Optimizing Compiler User’s Guide, Texas Instruments, 2000
[49] Code Composer Studio Getting Started Guide, Texas Instruments, 2001
[50] 田元,叶秀清,顾伟康. 实时图像处理系统中的优化编程. 电子技术应用,2000