基于H.264和Davinci技术的多媒体处理器设计与研究
|
摘要
近年来,我国矿山安全形势严峻,而一些矿用安全设备在功能、体积、重量等方面存在不足。因此,本文针对矿山应急救援设计了一种基于H.264和Davinci技术的多媒体处理器。该系统实现的功能主要包括:视频采集、压缩、存储、显示和传输;音频双向通信和存储;环境参数采集、存储和传输。
本设计采用Davinci技术构建系统软硬件平台。Davinci技术是TI公司为满足音视频系统开发的多方面需求而专门推出的一系列全新技术。该技术的处理器芯片根据音视频压缩应用进行了高效优化,具有集成度高、处理速度快等特点;其软件框架对复杂性较高的算法部分进行了模块化,增强了算法与应用程序的独立性,使得音视频编解码算法具有良好的扩展性。系统采用H.264视频压缩格式;图像分辨率可调,最大D1(704×576);视频帧率可调,最大25帧/秒。
本文采用模块化设计方法,完成了系统软硬件设计与部分实现。硬件部分,采用Davinci技术的TMS320DM6446芯片作为主处理器,该芯片内部集成ARM9核和DSP64x+ DSP核,提高了系统集成度、降低了系统板级成本;主要外围模块包括存储模块、视频模块、音频模块、网络通讯模块、通用异步串行模块、控制管理模块、电源模块等。软件部分,在Davinci技术软件框架下开发,采用MontaVista Linux作为操作系统;本文对视频数据的采集和压缩编码、MSP430单片机程序以及基于TCP/IP协议的多媒体网络通信程序进行了详细分析与设计。
该系统属于安防监控领域的新设备,既可应用于矿山应急救援,其研究成果也可在其它安防领域推广应用。目前,系统硬件部分的调试工作已基本完成;软件主要功能模块已完成设计,能够在TI的Davinci视频开发评估板上正常运行,达到了预期性能要求。
Recent years, the mine safety situation is very urgent. And, mine safety equipments have some shortcomings. Aiming at the mine emergency rescue, a multimedia information processing system is designed in this thesis.The processor has following functions: video collection, compression, memory, display and transmission; audio bi-directional communication and memory; environment parameter collecting, memory and transmission.
The hardware and software of system is designed with the Davinci technology. The Davinci is a new technology for video and audio compression. Aiming audio and video compression, the processor of Davinci technology had been optimized. And the algorithm parts of Davinci software framework are modularized; the independence of the algorithm and application procedures is enhanced. The main performance parameters: video compression format H.264; image compression resolution D1(704×576), adjustable down; frame-rate 25fps, adjustable down.
The thesis achieves the design and realization of some related software and hardware modules. The hardware uses Davinci dual-core processor TMS320DM6446 as the main processor,which integrates an ARM core and a C64x+ DSP core into one silicon; TMS320DM6446 improves the system integration and lowers the board level cost. The hardware design involves memory module, video module, audio module, ethernet module, UART module, power module and so on. And, the software is developed under Davinci software framework and uses MontaVista Linux as operating system. After analyzing software modules function, the thesis achieves the design of video capturing and compressing modules, MSP430F1232 module, net connection module.
The system is a kind of new safety watch equipment. Besides the mine rescue, this technical result can be applied to other safety watch domains. At present, the hardware circuit board of system has been debugged. And, the main software modules design of system has been completed, succeeded in running in Davinci digital video evaluation module (DVEVM).
本设计采用Davinci技术构建系统软硬件平台。Davinci技术是TI公司为满足音视频系统开发的多方面需求而专门推出的一系列全新技术。该技术的处理器芯片根据音视频压缩应用进行了高效优化,具有集成度高、处理速度快等特点;其软件框架对复杂性较高的算法部分进行了模块化,增强了算法与应用程序的独立性,使得音视频编解码算法具有良好的扩展性。系统采用H.264视频压缩格式;图像分辨率可调,最大D1(704×576);视频帧率可调,最大25帧/秒。
本文采用模块化设计方法,完成了系统软硬件设计与部分实现。硬件部分,采用Davinci技术的TMS320DM6446芯片作为主处理器,该芯片内部集成ARM9核和DSP64x+ DSP核,提高了系统集成度、降低了系统板级成本;主要外围模块包括存储模块、视频模块、音频模块、网络通讯模块、通用异步串行模块、控制管理模块、电源模块等。软件部分,在Davinci技术软件框架下开发,采用MontaVista Linux作为操作系统;本文对视频数据的采集和压缩编码、MSP430单片机程序以及基于TCP/IP协议的多媒体网络通信程序进行了详细分析与设计。
该系统属于安防监控领域的新设备,既可应用于矿山应急救援,其研究成果也可在其它安防领域推广应用。目前,系统硬件部分的调试工作已基本完成;软件主要功能模块已完成设计,能够在TI的Davinci视频开发评估板上正常运行,达到了预期性能要求。
Recent years, the mine safety situation is very urgent. And, mine safety equipments have some shortcomings. Aiming at the mine emergency rescue, a multimedia information processing system is designed in this thesis.The processor has following functions: video collection, compression, memory, display and transmission; audio bi-directional communication and memory; environment parameter collecting, memory and transmission.
The hardware and software of system is designed with the Davinci technology. The Davinci is a new technology for video and audio compression. Aiming audio and video compression, the processor of Davinci technology had been optimized. And the algorithm parts of Davinci software framework are modularized; the independence of the algorithm and application procedures is enhanced. The main performance parameters: video compression format H.264; image compression resolution D1(704×576), adjustable down; frame-rate 25fps, adjustable down.
The thesis achieves the design and realization of some related software and hardware modules. The hardware uses Davinci dual-core processor TMS320DM6446 as the main processor,which integrates an ARM core and a C64x+ DSP core into one silicon; TMS320DM6446 improves the system integration and lowers the board level cost. The hardware design involves memory module, video module, audio module, ethernet module, UART module, power module and so on. And, the software is developed under Davinci software framework and uses MontaVista Linux as operating system. After analyzing software modules function, the thesis achieves the design of video capturing and compressing modules, MSP430F1232 module, net connection module.
The system is a kind of new safety watch equipment. Besides the mine rescue, this technical result can be applied to other safety watch domains. At present, the hardware circuit board of system has been debugged. And, the main software modules design of system has been completed, succeeded in running in Davinci digital video evaluation module (DVEVM).
引文
[1] 李文峰, 韩晓冰, 汪仁, 张登福. 现代应急通信技术. 西安: 电子科技大学出版社, 2007. 6～7
[2] Van der Merwe, Martin. New Mine Rescue Techniques. Journal of the Mine Ventilation Society of South Africa, 1999, 52 (1): 20～21
[3] Jones B. New Technology Provides Effective Communications for Underground Rescue Operations. Coal International (Red hill, England), 1998, 246 (5): 171～174
[4] 李文峰, 郑学召. 一种矿山救援应急多媒体通信技术. 现代电子技术, 2005, 28(22): 43～45
[5] 魏利明, 陈相宁. 网络视频编码压缩标准发展及展望. 现代显示, 2006, 7: 24～25
[6] 倪伟, 郭宝龙, 王勇. H.26L 中新的帧内预测技术研究. 计算机工程与应用, 2004, 40(8): 42～45
[7] Teng Chia-Yuan. An improved block prediction mode for H.264/AVC intra-frame prediction. DCC, 2004, 3: 569～569
[8] Bojun Meng, Oscar C. An Fast Intra-Prediction Mode Selection for 4x4 Blocks in H.264. IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003, 3: 389～392
[9] X.Jing, L.P.Chau. Fast approach for H.264 inter mode decision. Electronics letters, 2004, 40 (17): 1050～1052
[10] Y.H.Kim, J.W.Yoo, S.W.Lee et al. Adaptive mode decision for H.264 encoder. Electronic letters, 2004, 40 (19):1172～1173
[11] A.C.Yu. Efficient block-size selection algorithm for inter-frame coding in H.264/MPEG- 4 AVC. ICASSP, 2004, 3: 169～172
[12] M.Wien. Variable block-size transforms for H.264/AVC. IEEE Transactions on circuits and systems for video technology, 2003, 13 (7): 606～613
[13] 张杰. 视频编码新标准 H.264/AVC 中的重要技术. 现代电子技术, 2004, 6 (137): 101～103
[14] Mathias Wien. Variable Block-Size Transforms for H.264/AVC. IEEE Transactions on circuits and systems for video technology, 2003, 13 (7), 604～613
[15] Henrique S.Malvar, Antti Hallapuro, Mart Karczewicz, et al. Low-Complexity Transform and Quantization in H.264/AVC. IEEE Transactions on circuits and systems for video technology, 2003, 13 (7): 598～602
[16] Miao Sima, Yuanhua Zhou, Wei Zhang. An efficient architecture for adaptive deblocking filter of H.264/AVC video coding. IEEE Transactions on Consumer Electronics, 2004, 50(1): 292～296
[17] S.Wenger. H.264/AVC over IP. IEEE Transactions on circuits and systems for video technology, 2003, (7): 645～656
[18] J.Teuhola. A Compression Method for Clustered Bit-Vectors. Information Processing Letter, 1978, 7 (10): 308～311
[19] 毕厚杰. 新一代视频压缩编码标准—H.264/AVC. 西安: 人民邮电出版社, 2006
[20] 宋磊, 方向忠. 达芬奇技术的视频应用分析. 电视技术, 2006, 9: 31～32
[21] TI, TMS320DM6446 Digital Media System-on-Chip (Rev. E), SPRS283, www.ti.com, 2006
[22] TI, TMS320C64x/C64x+ DSP CPU and Instruction Set Reference Guide (Rev. C) SPRU732C, www.altera.com, 2006
[23] 赵天云, 王洪迅, 等. DDR2 SDRAM 控制器的设计与实现. 微电子学与计算机, 2005, 22(3): 203～205
[24] Altera, Dedicated Pin Information for the MAX?II EPM240/EPM240G Devices Version 1.3, www.altera.com,2006.7
[25] TI, SN74AVCB164245 16-bit Dual-supply Bus Transceiver with Configurable Voltage Translation and 3-State Outputs, SCES394D, www.ti.com, 2005.6
[26] TI, SN74LVT16245B, 3.3V ABT 16-bit Bus Transceivers with 3-State Outputs, SCBS715E, www.ti.com, 2006.11
[27] TI, PCA9306 Dual Bidirectional I2C Bus and SMBus Voltage-level Translator, SCPS113, www.ti.com, 2005.5
[28] 李群芳, 张士军, 黄建. 单片微型计算机与接口技术 (第 2 版) . 北京: 电子工业出版社, 2004
[29] 周润景, 袁伟亭. Cadence 高速电路板设计与仿真. 北京: 电子工业出版社, 2006. 457～463
[30] Mark I.Montrose. 电磁兼容和印制电路板理论设计和布线. (刘元安, 李攸刚) . 北京: 人民邮电出版社, 2004. 108～114
[31] TI, Codec Engine Server Integrator User's Guide, SPRUED5B, www.ti.com, 2006.9
[32] TI, Codec Engine Application Developer User's Guide, SPRUE67D, www.ti.com, 2007.9
[33] 罗军舟, 黎波涛, 杨明等. TCP/IP 协议及网络编程技术. 北京: 清华大学出版社, 2004. 280～286
[2] Van der Merwe, Martin. New Mine Rescue Techniques. Journal of the Mine Ventilation Society of South Africa, 1999, 52 (1): 20～21
[3] Jones B. New Technology Provides Effective Communications for Underground Rescue Operations. Coal International (Red hill, England), 1998, 246 (5): 171～174
[4] 李文峰, 郑学召. 一种矿山救援应急多媒体通信技术. 现代电子技术, 2005, 28(22): 43～45
[5] 魏利明, 陈相宁. 网络视频编码压缩标准发展及展望. 现代显示, 2006, 7: 24～25
[6] 倪伟, 郭宝龙, 王勇. H.26L 中新的帧内预测技术研究. 计算机工程与应用, 2004, 40(8): 42～45
[7] Teng Chia-Yuan. An improved block prediction mode for H.264/AVC intra-frame prediction. DCC, 2004, 3: 569～569
[8] Bojun Meng, Oscar C. An Fast Intra-Prediction Mode Selection for 4x4 Blocks in H.264. IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003, 3: 389～392
[9] X.Jing, L.P.Chau. Fast approach for H.264 inter mode decision. Electronics letters, 2004, 40 (17): 1050～1052
[10] Y.H.Kim, J.W.Yoo, S.W.Lee et al. Adaptive mode decision for H.264 encoder. Electronic letters, 2004, 40 (19):1172～1173
[11] A.C.Yu. Efficient block-size selection algorithm for inter-frame coding in H.264/MPEG- 4 AVC. ICASSP, 2004, 3: 169～172
[12] M.Wien. Variable block-size transforms for H.264/AVC. IEEE Transactions on circuits and systems for video technology, 2003, 13 (7): 606～613
[13] 张杰. 视频编码新标准 H.264/AVC 中的重要技术. 现代电子技术, 2004, 6 (137): 101～103
[14] Mathias Wien. Variable Block-Size Transforms for H.264/AVC. IEEE Transactions on circuits and systems for video technology, 2003, 13 (7), 604～613
[15] Henrique S.Malvar, Antti Hallapuro, Mart Karczewicz, et al. Low-Complexity Transform and Quantization in H.264/AVC. IEEE Transactions on circuits and systems for video technology, 2003, 13 (7): 598～602
[16] Miao Sima, Yuanhua Zhou, Wei Zhang. An efficient architecture for adaptive deblocking filter of H.264/AVC video coding. IEEE Transactions on Consumer Electronics, 2004, 50(1): 292～296
[17] S.Wenger. H.264/AVC over IP. IEEE Transactions on circuits and systems for video technology, 2003, (7): 645～656
[18] J.Teuhola. A Compression Method for Clustered Bit-Vectors. Information Processing Letter, 1978, 7 (10): 308～311
[19] 毕厚杰. 新一代视频压缩编码标准—H.264/AVC. 西安: 人民邮电出版社, 2006
[20] 宋磊, 方向忠. 达芬奇技术的视频应用分析. 电视技术, 2006, 9: 31～32
[21] TI, TMS320DM6446 Digital Media System-on-Chip (Rev. E), SPRS283, www.ti.com, 2006
[22] TI, TMS320C64x/C64x+ DSP CPU and Instruction Set Reference Guide (Rev. C) SPRU732C, www.altera.com, 2006
[23] 赵天云, 王洪迅, 等. DDR2 SDRAM 控制器的设计与实现. 微电子学与计算机, 2005, 22(3): 203～205
[24] Altera, Dedicated Pin Information for the MAX?II EPM240/EPM240G Devices Version 1.3, www.altera.com,2006.7
[25] TI, SN74AVCB164245 16-bit Dual-supply Bus Transceiver with Configurable Voltage Translation and 3-State Outputs, SCES394D, www.ti.com, 2005.6
[26] TI, SN74LVT16245B, 3.3V ABT 16-bit Bus Transceivers with 3-State Outputs, SCBS715E, www.ti.com, 2006.11
[27] TI, PCA9306 Dual Bidirectional I2C Bus and SMBus Voltage-level Translator, SCPS113, www.ti.com, 2005.5
[28] 李群芳, 张士军, 黄建. 单片微型计算机与接口技术 (第 2 版) . 北京: 电子工业出版社, 2004
[29] 周润景, 袁伟亭. Cadence 高速电路板设计与仿真. 北京: 电子工业出版社, 2006. 457～463
[30] Mark I.Montrose. 电磁兼容和印制电路板理论设计和布线. (刘元安, 李攸刚) . 北京: 人民邮电出版社, 2004. 108～114
[31] TI, Codec Engine Server Integrator User's Guide, SPRUED5B, www.ti.com, 2006.9
[32] TI, Codec Engine Application Developer User's Guide, SPRUE67D, www.ti.com, 2007.9
[33] 罗军舟, 黎波涛, 杨明等. TCP/IP 协议及网络编程技术. 北京: 清华大学出版社, 2004. 280～286