嵌入式流媒体视频监控系统的设计与实现
摘要
近年来，随着多媒体技术及无线传输技术的发展，基于嵌入式流媒体技术的视频采集传输系统作为远程视频监控、可视电话会议和工业自动控制领域的一项核心关键技术得到了飞速的发展。因此研究在嵌入式平台上实现国际上流行的视频编解码技术、流媒体传输技术将有着广阔的应用前景和巨大的社会效益及经济效益。
本文以一个实际的嵌入式视频监控系统开发为背景，对嵌入式系统实现的关键技术，嵌入式硬件平台的选型及嵌入式视频监控服务器端的软件系统设计及实现方法都进行了重点研究。
通过研究国际上流行的嵌入式流媒体通信系统结构框架，结合本系统设计时所要求的性能指标，在硬件平台的选择上，基于freescale推出的ARM926EJ-S内核的i．MX处理器所具有的实时MPEG4和H．263编解码能力及其在多媒体应用上的诸多特点，因此我们选用i．MX21系列MC9328MX21VM微处理器作为系统硬件平台的核心部件；在软件平台上我们选用源代码开放的ARM Linux操作系统；在选择视频压缩标准时，通过相应的仿真测试分析，综合考虑压缩性能及运算量的因素，选用现阶段流行的MPEG4视频压缩标准；在多媒体数据传输协议上，我们选择了实时流媒体传输协议RTP／RTCP及RTSP。
本文对设计裁减嵌入式ARM Linux内核及构建文件系统、设计移植图形用户界面、相关外围硬件设备在ARM Linux系统上驱动的开发均做了详细介绍，并就多媒体数据的采集、编码及传输模块在嵌入式系统中的实现做了重点研究，系统体系结构清晰，可方便地进行移植和扩展，利用本系统可实现无线视频监控，具有小型化，低功耗，稳定可靠等特点。
In recent years, with the development of multimedia technique and wireless transmission technique, video capture and video transmission system based on embedded streaming technique is developing rapidly. This technique becomes a key technique in the field of remote video monitoring, video conference and industrial autocontrol. So it has extensive applications and great social and economic benefit to research the popular video coding-decoding technology and transmission technology of streaming media on embedded platforms.
This paper takes the exploitation of a practical embedded video monitoring system as the background and studies the key techniques of embedded system. Besides, the type selection of embedded hardware platform, the design and the implementation of software system on embedded video monitoring server are studied in detail.
This paper studies the popular structure frame of embedded streaming communication systems combining with the demanded specifications of the system. As the series of i.MX microprocessor based on freescale's ARM926EJ-S~(TM) core is capable in real-time MPEG4 and H.263 coding-decoding and it has many advantages in multimedia applications,we have selected MC9328MX21VM microprocessor of i.MX21 as the key component of the hardware platform.Besides,we have selected the free software ARM Linux operating system as the software platform; After analyzing the simulation testing and taking into account both compressibility and computational cost, we have selected MPEG4 as the criterion of video compression; What's more,we have selected the real-time streaming transport protocols RTP/RTCP and RTSP as the multimedia transport protocols.
This paper introduces the design and reduction of the embedded ARM Linux core, the design and grafing of graphic user interface and the exploiting of the hardware equipment driver in ARM Linux system in detail. Specially, the implementation of multimedia data capture, coding and transmission in embedded system are studied in particular. The structure of system has good expansibility and clear framework. With this system, we can carry out wireless video monitoring, and the system is miniaturized, low power comsumed, reliable and stable.
本文以一个实际的嵌入式视频监控系统开发为背景，对嵌入式系统实现的关键技术，嵌入式硬件平台的选型及嵌入式视频监控服务器端的软件系统设计及实现方法都进行了重点研究。
通过研究国际上流行的嵌入式流媒体通信系统结构框架，结合本系统设计时所要求的性能指标，在硬件平台的选择上，基于freescale推出的ARM926EJ-S内核的i．MX处理器所具有的实时MPEG4和H．263编解码能力及其在多媒体应用上的诸多特点，因此我们选用i．MX21系列MC9328MX21VM微处理器作为系统硬件平台的核心部件；在软件平台上我们选用源代码开放的ARM Linux操作系统；在选择视频压缩标准时，通过相应的仿真测试分析，综合考虑压缩性能及运算量的因素，选用现阶段流行的MPEG4视频压缩标准；在多媒体数据传输协议上，我们选择了实时流媒体传输协议RTP／RTCP及RTSP。
本文对设计裁减嵌入式ARM Linux内核及构建文件系统、设计移植图形用户界面、相关外围硬件设备在ARM Linux系统上驱动的开发均做了详细介绍，并就多媒体数据的采集、编码及传输模块在嵌入式系统中的实现做了重点研究，系统体系结构清晰，可方便地进行移植和扩展，利用本系统可实现无线视频监控，具有小型化，低功耗，稳定可靠等特点。
In recent years, with the development of multimedia technique and wireless transmission technique, video capture and video transmission system based on embedded streaming technique is developing rapidly. This technique becomes a key technique in the field of remote video monitoring, video conference and industrial autocontrol. So it has extensive applications and great social and economic benefit to research the popular video coding-decoding technology and transmission technology of streaming media on embedded platforms.
This paper takes the exploitation of a practical embedded video monitoring system as the background and studies the key techniques of embedded system. Besides, the type selection of embedded hardware platform, the design and the implementation of software system on embedded video monitoring server are studied in detail.
This paper studies the popular structure frame of embedded streaming communication systems combining with the demanded specifications of the system. As the series of i.MX microprocessor based on freescale's ARM926EJ-S~(TM) core is capable in real-time MPEG4 and H.263 coding-decoding and it has many advantages in multimedia applications,we have selected MC9328MX21VM microprocessor of i.MX21 as the key component of the hardware platform.Besides,we have selected the free software ARM Linux operating system as the software platform; After analyzing the simulation testing and taking into account both compressibility and computational cost, we have selected MPEG4 as the criterion of video compression; What's more,we have selected the real-time streaming transport protocols RTP/RTCP and RTSP as the multimedia transport protocols.
This paper introduces the design and reduction of the embedded ARM Linux core, the design and grafing of graphic user interface and the exploiting of the hardware equipment driver in ARM Linux system in detail. Specially, the implementation of multimedia data capture, coding and transmission in embedded system are studied in particular. The structure of system has good expansibility and clear framework. With this system, we can carry out wireless video monitoring, and the system is miniaturized, low power comsumed, reliable and stable.
引文
[1] 刘富强，数字视频监控系统开发及应用，机械工业出版社，2003
[2] 刘富强，卢赤班，数字视频监控系统及其应用，工矿自动化，No．3 Jun．2003
[3] 钟玉琢，向哲，沈洪等，流媒体和视频服务器，清华大学出版社，2003
[4] Tan Guang, Jin Hai, Pang Liping. A Scalable Video Server Using Intelligent Network Attached Storage. Proceedings of IFIP/IEEE International Conference on Management of Multimedia Networks and Services-Lecture Notes in Computer Sciences, Vol.2496, Springer-Verlag, 2002-10: 114-126
[5] Apple Computer Inc. Open Source Project: Darwin Streaming Server. http://developer.apple.com/darwin/projects/streaming, 2004
[6] Zimmermann R. Yima: Design and Evaluation of a Streaming Media System for Residential Broadband Services. Proc. VLDB 2001 Workshop Databases in Telecommunications (DBTel 01), Springer-Verlag, 2001: 116-125
[7] 杜春雷．ARM体系结构与编程．北京：清华大学出版社，2003
[8] 彭懿涛，夏惊涛，穆道生，基于嵌入式技术的远程视频监控系统，测控技术，2006，Vol．25，No．4
[9] Bjork.N, Christopoulos, C, Transcoder architectures for video coding, Proceedings of IEEE International Conference on Acoustics, Speech, Speech and Signal Processing, 1998, 5: 2813—2816
[10] 小野定康、铃木纯司，JPEG／MPEG2技术，北京：科学出版社，2004
[11] 陈乾宗，JPEG基本系统编码分析与实现，浙江大学，学士学位论文，2004
[12] Lookabaugh T，李煜晖，朱山风，段上为译，多媒体数字压缩原理与标准[M]，北京：电子工业出版社，2000
[13] 钟玉琢，王琪，贺玉文，基于对象的多媒体数据压缩编码国际标准MPEG4及其校验模型[M]．北京：科学出版社，2000．433-435
[14] ISO/IEC JTC1/SC29/WG11 N4668, Overview of the MPEG-4 Standard, March 2002
[15] 黄增锋，基于TMS320C6416的MPEG-2／MPEG-4视频流转码器，广西大学，硕士学位论文，2005
[16] RFC 3550-2003, RTP: A transport protocol for real-time applications[S]
[17] Worrall.S.T, Sadka.A.H, Sweeney.P, Kondoz.A.M. Optimal packetisation of MPEG-4 using RTP over mobile networks. Communications, IEE Proceedings, Volume: 148, Issue: 4, Aug.2001. Pages: 197-201
[18] Freescale Semiconductor Data Sheet: Technical Data, MC9328MX21, Document Number: MC9328MX21 Rev.3.1, 2006.7
[19] Freescale Semiconductor Data Sheet: i.MX21 Applications Processor Reference Manual, Document Number: MC9328MX21RM, Rev.2, 2005.5
[20] 华恒科技，HHARMMX21开发平台技术手册，2005
[21] 潘巨龙，黄宁，姚伏天，陈科杰，道克刚，ARM9嵌入式Linux系统构建与应用，北京航空航天大学出版社，2006
[22] Alessandro Rubini，Linux设备驱动程序第二版，中国电力出版社，2002
[23] Freescale Semiconductor Application Note: Image Capture Using PrP, CSI, and I2C MC9328MX21 Document Number: AN3285 Rev.0, 2006.8
[24] Freescale Semiconductor Application Note: Image Capture with MC9328MX21, Document Number: AN2676 Rev. 1, 2005.10
[25] Freescale Semiconductor Application Note: Operating Principle of Resize in the eMMA Pre-Processor MC9328MX21, AN2886/D Rev.0, 2004.11
[26] NORDIC, PRELIMINARY PRODUCT SPECIFICATION, Single chip 2.4 GHz Transceiver nRF24L01
[27] Wayne Self，孙玉芳，梁彬，罗保国，谢谦译，嵌入式计算机系统设计原理，北京机械工业出版社，2002
[28] 孙纪坤，张小全，嵌入式Linux系统开发技术详解．基于ARM，人民邮电出版社，2006
[29] 黄宁，基于ARM9平台的嵌入式Linux开发，华恒科技，2005
[30] 詹荣开，嵌入式系统Boot Loader技术内幕，http://www.ibm.com/developerworks/cn/linux/1-btloader/index.html，2003．12
[31] 刘峥嵘，张智超，许振山等编著，嵌入式Linux应用开发详解，机械工业出版社，2004
[32] Scot Maxwell，冯锐，邢飞译，刘隆国等译，Linux内核源代码分析．北京：机械工业出版社．2000
[33] 李驹光等，ARM应用系统开发详解，北京：清华大学出版社，2003
[34] T.Sridhar, Designing Embedded Communications Software, USA: CMP Book, 2003
[35] 孙天泽，袁文菊，张海峰，嵌入式设计及Linux驱动开发指南-基于ARM9处理器，电子工业出版社，2005
[36] Sarwar，AI-Saqabi，英宇，姚锋译，Linux & UNIX程序开发基础教程，清华大学出版社，2004
[37] 潘泰才，基于ARM的远程图像监控系统设计，浙江大学，硕士学位论文，2006
[38] 李春杰，刘瑞霞，基于一种新型嵌入式系统级芯片的无线数据采集系统的设计，现代电子技术，2006．3
[39] 王庆华，屈玉贵，赵保华，洪飞，无线传感器开发系统的设计及实现，电子技术应用，2006．6
[40] 张丽，流媒体技术大全，北京：中国青年出版社，2001
[41] 钟礼秋，远程监控系统客户端软件的设计与实现，电子科技大学，硕士学位论文，2005
[42] 飞漫软件，MiniGUI用户手册-适用于MiniGUI Ver 1.3.x，2003．10
[43] 飞漫软件，MiniGUI编程指南-适用于MiniGUI Ver 1.3.x，2003．10
[2] 刘富强，卢赤班，数字视频监控系统及其应用，工矿自动化，No．3 Jun．2003
[3] 钟玉琢，向哲，沈洪等，流媒体和视频服务器，清华大学出版社，2003
[4] Tan Guang, Jin Hai, Pang Liping. A Scalable Video Server Using Intelligent Network Attached Storage. Proceedings of IFIP/IEEE International Conference on Management of Multimedia Networks and Services-Lecture Notes in Computer Sciences, Vol.2496, Springer-Verlag, 2002-10: 114-126
[5] Apple Computer Inc. Open Source Project: Darwin Streaming Server. http://developer.apple.com/darwin/projects/streaming, 2004
[6] Zimmermann R. Yima: Design and Evaluation of a Streaming Media System for Residential Broadband Services. Proc. VLDB 2001 Workshop Databases in Telecommunications (DBTel 01), Springer-Verlag, 2001: 116-125
[7] 杜春雷．ARM体系结构与编程．北京：清华大学出版社，2003
[8] 彭懿涛，夏惊涛，穆道生，基于嵌入式技术的远程视频监控系统，测控技术，2006，Vol．25，No．4
[9] Bjork.N, Christopoulos, C, Transcoder architectures for video coding, Proceedings of IEEE International Conference on Acoustics, Speech, Speech and Signal Processing, 1998, 5: 2813—2816
[10] 小野定康、铃木纯司，JPEG／MPEG2技术，北京：科学出版社，2004
[11] 陈乾宗，JPEG基本系统编码分析与实现，浙江大学，学士学位论文，2004
[12] Lookabaugh T，李煜晖，朱山风，段上为译，多媒体数字压缩原理与标准[M]，北京：电子工业出版社，2000
[13] 钟玉琢，王琪，贺玉文，基于对象的多媒体数据压缩编码国际标准MPEG4及其校验模型[M]．北京：科学出版社，2000．433-435
[14] ISO/IEC JTC1/SC29/WG11 N4668, Overview of the MPEG-4 Standard, March 2002
[15] 黄增锋，基于TMS320C6416的MPEG-2／MPEG-4视频流转码器，广西大学，硕士学位论文，2005
[16] RFC 3550-2003, RTP: A transport protocol for real-time applications[S]
[17] Worrall.S.T, Sadka.A.H, Sweeney.P, Kondoz.A.M. Optimal packetisation of MPEG-4 using RTP over mobile networks. Communications, IEE Proceedings, Volume: 148, Issue: 4, Aug.2001. Pages: 197-201
[18] Freescale Semiconductor Data Sheet: Technical Data, MC9328MX21, Document Number: MC9328MX21 Rev.3.1, 2006.7
[19] Freescale Semiconductor Data Sheet: i.MX21 Applications Processor Reference Manual, Document Number: MC9328MX21RM, Rev.2, 2005.5
[20] 华恒科技，HHARMMX21开发平台技术手册，2005
[21] 潘巨龙，黄宁，姚伏天，陈科杰，道克刚，ARM9嵌入式Linux系统构建与应用，北京航空航天大学出版社，2006
[22] Alessandro Rubini，Linux设备驱动程序第二版，中国电力出版社，2002
[23] Freescale Semiconductor Application Note: Image Capture Using PrP, CSI, and I2C MC9328MX21 Document Number: AN3285 Rev.0, 2006.8
[24] Freescale Semiconductor Application Note: Image Capture with MC9328MX21, Document Number: AN2676 Rev. 1, 2005.10
[25] Freescale Semiconductor Application Note: Operating Principle of Resize in the eMMA Pre-Processor MC9328MX21, AN2886/D Rev.0, 2004.11
[26] NORDIC, PRELIMINARY PRODUCT SPECIFICATION, Single chip 2.4 GHz Transceiver nRF24L01
[27] Wayne Self，孙玉芳，梁彬，罗保国，谢谦译，嵌入式计算机系统设计原理，北京机械工业出版社，2002
[28] 孙纪坤，张小全，嵌入式Linux系统开发技术详解．基于ARM，人民邮电出版社，2006
[29] 黄宁，基于ARM9平台的嵌入式Linux开发，华恒科技，2005
[30] 詹荣开，嵌入式系统Boot Loader技术内幕，http://www.ibm.com/developerworks/cn/linux/1-btloader/index.html，2003．12
[31] 刘峥嵘，张智超，许振山等编著，嵌入式Linux应用开发详解，机械工业出版社，2004
[32] Scot Maxwell，冯锐，邢飞译，刘隆国等译，Linux内核源代码分析．北京：机械工业出版社．2000
[33] 李驹光等，ARM应用系统开发详解，北京：清华大学出版社，2003
[34] T.Sridhar, Designing Embedded Communications Software, USA: CMP Book, 2003
[35] 孙天泽，袁文菊，张海峰，嵌入式设计及Linux驱动开发指南-基于ARM9处理器，电子工业出版社，2005
[36] Sarwar，AI-Saqabi，英宇，姚锋译，Linux & UNIX程序开发基础教程，清华大学出版社，2004
[37] 潘泰才，基于ARM的远程图像监控系统设计，浙江大学，硕士学位论文，2006
[38] 李春杰，刘瑞霞，基于一种新型嵌入式系统级芯片的无线数据采集系统的设计，现代电子技术，2006．3
[39] 王庆华，屈玉贵，赵保华，洪飞，无线传感器开发系统的设计及实现，电子技术应用，2006．6
[40] 张丽，流媒体技术大全，北京：中国青年出版社，2001
[41] 钟礼秋，远程监控系统客户端软件的设计与实现，电子科技大学，硕士学位论文，2005
[42] 飞漫软件，MiniGUI用户手册-适用于MiniGUI Ver 1.3.x，2003．10
[43] 飞漫软件，MiniGUI编程指南-适用于MiniGUI Ver 1.3.x，2003．10