嵌入式环境中流媒体网络视频监控系统的研究与开发
|
摘要
众所周知,人类通过视觉获取的信息量约占总信息量的70%,而且视频信息具有直观性、可信性等一系列优点。近年来,随着网络技术、多媒体技术、通信技术的快速发展,网络视频技术的应用日益增多,市场需求也越来越大。应用非常广泛,从日常生活、工业生产直到现代安防、科学研究等领域都已涉足。目前,视频监控开始突破传统的时空限制,向网络化,数字化方向发展。以计算机技术为基础,以网络为依托,以嵌入式设备为载体的视频监控可以使实时远距离传输成为可能。
嵌入式技术是计算机技术的延伸,其出现使得计算机研究进入一个新的领域,成为当今的热门话题之一。本文在总结分析以往研究成果的基础上,将嵌入式技术、网络技术、视频技术有机的结合起来,提出了基于嵌入式平台的流媒体格式传输的网络视频监控系统的设计方案,其特点是性能稳定、维护管理方便、可扩展性强。与基于PC机的视频系统相比,其优点是成本低、功耗小、应用灵活、易扩展和升级。系统利用网络实现远程监控,摄像头采集到的数据经开发板传送到Web服务器,监控人员在客户端就可以浏览被监视端的情况。
本文以嵌入式系统、视频采集和流媒体传输为背景,总结了现代嵌入式系统的特点、原理与开发方法,论述了系统开发环境的构建、系统的移植、视频采集程序和流媒体传输程序的设计与实现。本文采用基于ARM9核的三星s3c2410处理器的开发板和USB摄像头的硬件,软件采用Linux内核开发平台。在嵌入式开发环境构建中,介绍了Linux在宿主机的安装和设置,交叉编译器的制作;在系统移植方面介绍了Bootloader和Linux内核的移植、根文件系统的制作,在驱动程序的移植方面重点介绍了USB通信原理和如何利用现有驱动程序来编写相应设备的驱动程序,这是本文的一个创新点;视频采集方面利用相关库提出了多线程采集的思路,有助于加快采集速度;在流媒体方面重点介绍了利用现有库文件来编写流媒体格式传输方法,以提高工作效率;最后本文还介绍了程序的烧写与测试,这一步是嵌入式系统所特有的工作。应用程序设计采用了模块化设计的方法,减少模块的耦合性,提高了系统的效率。在所开发的视频监控系统中,文中讨论的研究技术已经获得成功,取得了良好的效果。
后PC时代,嵌入式系统将拥有非常大的市场潜力,从事嵌入式系统开发的人员也越来越多。对嵌入式系统的研究与开发除了需要丰富的软硬件知识外,还需要有大量的实践经验,理论与实际相结合是研究嵌入式系统的有效手段,也是促进嵌入式系统快速发展的方法。展望未来,明天的嵌入式系统会比今天更便宜、小巧、可靠、高效及智能化,嵌入式系统的发展潜力巨大无比。
It is well known that the information content obtained by vision occupies 70% in the total information content, and video frequency information has a series of advantages of visualization and reliability. In recent years, according to the fast development of network technology, multimedia technology, communication technology, the market need of network video frequency is widely used in many fields, such as daily life, industrial production, modern security, scientific research. Now, video frequency surveillance begin to break out traditional space-time limit, towards the development of network and digitalization. Real-time long-range transport become possible through video frequency surveillance based on computer technology, network technology, embedded equipment.
The embedded technology is the spread of computer technology, that is to say, it makes computer technology entering into a new field. So it becomes one of the hottest topics. Based on the previous research results, this paper put forward design program of network video frequency surveillance system of streaming-media transport on the embedded platform, conbining with embedded technology、network technology、video frequency technology. It has the features of stable performance、easy maintenance and management、strong expansibility, and the advantages of low cost、low power、flexible use、strong expansion and upgrade, compared with video frequency system on PC computer. This system has realized remote supervision using network, the data collected by camera is transported to Web server through development board, so in this condition, the client can brows the monitor.
This dissertation summarizes the features, theory and development method of modern embedded system, and discusses the construction of developing environment, system transplantation, design and implementation of video collection program and streaming-media transportation program, on the background of embedded system、video collection and streaming-media transportation. It adopts the development board of Samsung s3c2410 processor based on ARM9 board and the hardware of USB camera, and the software on the platform of Linux kernel. In the construction of embedded developing environment, the installation and setting of Linux on the host computer are introduced. In the system transplantation, transplantation of Bootloader and Linux kernel, the manufacture of Root File System are introduced. In the transplantation of driver program, USB communication theory and the driver program of the related device how to make by using the exist driver program are introduced emphatically, which is also an innovation. In the field of video collection, the multi-threaded collection thoughts are put forward by using the related library, help to accelerating collection speed. In the field of streaming media, the streaming-media transportation method made by using the exist library file is introduced emphatically so as to improve work efficiency. At last, program download and testing are introduced, which is the specific work in the embedded system. The application adopts module design method, to reduce the coupling, to improve the system efficiency. In the developed video frequency surveillance, the studied technology discussed achieves success and has a better effect.
The embedded system will have the greater market potential and the more developers busy on it in post PC era. Apart from the abundance of software and hardware knowledge, it needs the large of practise experience.The integration of theory and practice are both an effective means of the researhing embedded system and the method of promoting the embedded system fast developing. Looking into the future, the embedded system will be cheaper, smaller, more realiable, more efficient and more intelligent than today.Embedded system will have a greater market.
嵌入式技术是计算机技术的延伸,其出现使得计算机研究进入一个新的领域,成为当今的热门话题之一。本文在总结分析以往研究成果的基础上,将嵌入式技术、网络技术、视频技术有机的结合起来,提出了基于嵌入式平台的流媒体格式传输的网络视频监控系统的设计方案,其特点是性能稳定、维护管理方便、可扩展性强。与基于PC机的视频系统相比,其优点是成本低、功耗小、应用灵活、易扩展和升级。系统利用网络实现远程监控,摄像头采集到的数据经开发板传送到Web服务器,监控人员在客户端就可以浏览被监视端的情况。
本文以嵌入式系统、视频采集和流媒体传输为背景,总结了现代嵌入式系统的特点、原理与开发方法,论述了系统开发环境的构建、系统的移植、视频采集程序和流媒体传输程序的设计与实现。本文采用基于ARM9核的三星s3c2410处理器的开发板和USB摄像头的硬件,软件采用Linux内核开发平台。在嵌入式开发环境构建中,介绍了Linux在宿主机的安装和设置,交叉编译器的制作;在系统移植方面介绍了Bootloader和Linux内核的移植、根文件系统的制作,在驱动程序的移植方面重点介绍了USB通信原理和如何利用现有驱动程序来编写相应设备的驱动程序,这是本文的一个创新点;视频采集方面利用相关库提出了多线程采集的思路,有助于加快采集速度;在流媒体方面重点介绍了利用现有库文件来编写流媒体格式传输方法,以提高工作效率;最后本文还介绍了程序的烧写与测试,这一步是嵌入式系统所特有的工作。应用程序设计采用了模块化设计的方法,减少模块的耦合性,提高了系统的效率。在所开发的视频监控系统中,文中讨论的研究技术已经获得成功,取得了良好的效果。
后PC时代,嵌入式系统将拥有非常大的市场潜力,从事嵌入式系统开发的人员也越来越多。对嵌入式系统的研究与开发除了需要丰富的软硬件知识外,还需要有大量的实践经验,理论与实际相结合是研究嵌入式系统的有效手段,也是促进嵌入式系统快速发展的方法。展望未来,明天的嵌入式系统会比今天更便宜、小巧、可靠、高效及智能化,嵌入式系统的发展潜力巨大无比。
It is well known that the information content obtained by vision occupies 70% in the total information content, and video frequency information has a series of advantages of visualization and reliability. In recent years, according to the fast development of network technology, multimedia technology, communication technology, the market need of network video frequency is widely used in many fields, such as daily life, industrial production, modern security, scientific research. Now, video frequency surveillance begin to break out traditional space-time limit, towards the development of network and digitalization. Real-time long-range transport become possible through video frequency surveillance based on computer technology, network technology, embedded equipment.
The embedded technology is the spread of computer technology, that is to say, it makes computer technology entering into a new field. So it becomes one of the hottest topics. Based on the previous research results, this paper put forward design program of network video frequency surveillance system of streaming-media transport on the embedded platform, conbining with embedded technology、network technology、video frequency technology. It has the features of stable performance、easy maintenance and management、strong expansibility, and the advantages of low cost、low power、flexible use、strong expansion and upgrade, compared with video frequency system on PC computer. This system has realized remote supervision using network, the data collected by camera is transported to Web server through development board, so in this condition, the client can brows the monitor.
This dissertation summarizes the features, theory and development method of modern embedded system, and discusses the construction of developing environment, system transplantation, design and implementation of video collection program and streaming-media transportation program, on the background of embedded system、video collection and streaming-media transportation. It adopts the development board of Samsung s3c2410 processor based on ARM9 board and the hardware of USB camera, and the software on the platform of Linux kernel. In the construction of embedded developing environment, the installation and setting of Linux on the host computer are introduced. In the system transplantation, transplantation of Bootloader and Linux kernel, the manufacture of Root File System are introduced. In the transplantation of driver program, USB communication theory and the driver program of the related device how to make by using the exist driver program are introduced emphatically, which is also an innovation. In the field of video collection, the multi-threaded collection thoughts are put forward by using the related library, help to accelerating collection speed. In the field of streaming media, the streaming-media transportation method made by using the exist library file is introduced emphatically so as to improve work efficiency. At last, program download and testing are introduced, which is the specific work in the embedded system. The application adopts module design method, to reduce the coupling, to improve the system efficiency. In the developed video frequency surveillance, the studied technology discussed achieves success and has a better effect.
The embedded system will have the greater market potential and the more developers busy on it in post PC era. Apart from the abundance of software and hardware knowledge, it needs the large of practise experience.The integration of theory and practice are both an effective means of the researhing embedded system and the method of promoting the embedded system fast developing. Looking into the future, the embedded system will be cheaper, smaller, more realiable, more efficient and more intelligent than today.Embedded system will have a greater market.
引文
[1]http://www.iee.org/policy/areas/y2k/w-43.cfm
[2]Zhao Jian Wang Haili Li Bo.Research and Realize the Key Technology of the Soft System For Instrument Platform Based on the Embedded Linux.The Eighth International Conference on Electronic Measurement and Instruments,2007:2-426
[3]李善平,刘文峰,王焕龙等.Linux与嵌入式系统(第2版).北京:清华大学出版社,2006-3
[4]Baker Mohammad,Paul Bassett,Jacob Abraham,and Adnan Aziz.CACHE ORGANIZATION FOR EMBEDED PROCESSORS:CAM-vs-SRAM.IEEE,2006:299
[5]John L.Hennessy,David A.Patterson.Computer Architecture:A Quantitative Approach,Third Edition.
[6]Alex Lennon.Embedding Linux.Embedded system.IEE REVIEW 2001:34-35
[7]Collins R,et al.A system for video surveillance and monitor:VASM final report.Carnegie Mellon University's Technical Report.2000
[8]第二届全国智能视觉监控学术会议即将在京举办.http://wwww.cas.cn/html/Dir/2003/12/05/6714.htm
[9]David A.Patterson,John L.Hennessy.Computer Organization and Design:The Hardware/Software Interface,Third Edition
[10]毛德操,胡希明.Linux内核源代码情景分析.杭州:浙江大学出版社,2001-9
[11]倪继利.Linux内核分析及编程.北京:电子工业出版社,2006-1
[12]Debian GNU/Linux Installation Guide.http://www.debian.org/releases/stable/i386/
[13]信息产业部软件与集成电路促进中心.Debian Linux系统配置与管理.北京:电子工业出版社,2006-1
[14]Karim Yaghmour.Building Embedded Linux Systems.O'REILLY
[15]夏明.基于Linux的嵌入式监控系统软件平台研究与设计:[硕士学位论文].南京理工大学控制理论与控制工程,2007
[16]Kyung Ho Chung,Myung Sil Choi,Kwang Seon Ahn.A Study on the Packaging for Fast Boot-up Time in the Embedded Linux.13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications(RTCSA 2007):1
[17]沈猛.基于HHARM9-EDU平台的嵌入式操作系统引导程序的设计.电脑知识与技术,2005:120
[18]孙天泽,袁文菊,张海峰.嵌入式设计及LINUX驱动开发指南--基于ARM 9处理器.北京:电子工业出版社,2005-9
[19]张静,叶梧,冯穗力.基于ARM 920T的嵌入式Linux系统开发.现代电子技术,2005年第4期:23
[20]白伟平,包启亮.基于ARM的嵌入式Boot Loader浅析.微计算机信息,2006年第22卷:99
[21]PengLi,YuLu,HongxingWei.Realization of Embedded Multimedia System Based On Dual-Core Processor OMAP5910.IMACS Multiconference on "Computational Engineering in Systems Applications"(CESA),2006:101
[22]曾宏安,齐尧,焦振强等.用U-BOOT构建嵌入式系统的引导装载程序.单片机与嵌入式系统应用,2005.2:82-83
[23]http://www.davicom.com.tw/big5/download/Data%20Sheet/DM9000A-DS-F01-101906.pdf
[24]管秋梅,胡仁杰.基于嵌入式Linux的网络设备驱动设计与实现.电子工程师,2007-3:77
[25]Jonathan Corbet,Alessandro Rubini,Greg Kroah-Hartman,Linux Device Drivers,3rd Edition
[26]Jim Mellander,Lawrence Berkeley National Laboratory.Unix Filesystem Security.Information Security Technical Report,2002,Vol7,No.1:11
[27]潘巨龙,黄宁,姚伏天等.ARM9嵌入式Linux系统构建与应用.北京:北京航空航天大学,2006-8
[28]http://www.busybox.net/about.html
[29]孙辉,陆松年,杨树堂.基于Linux和S3c2410的嵌入式Web Server的研究与实现.计算机应用与软件,2007-2,Vol124,No.2:134
[30]Compaq,Hewlett-Packard,Intel.Universal Serial Bus Specification.2000-4:26
[31]张卓亮.基于Linux系统的USB HOST驱动程序设计与实现.中国集成电路,2007-11:30
[32]Agilent.Agilent CMOS Image Sensors HDCS-1020(CIF)and HDCS-2020(VGA)Product Brief.http://www.ortodoxism.ro/datasheets2/2/05jj45dcrga6zr0zjg7hrde83cpy.pdf
[33]刘文峰,李程远,李善平.嵌入式L inux操作系统的研究.浙江大学学报(工学版),2004-4:450
[34]李献霞,孟小锁.嵌入式系统源码调试器GDB的远程通信.微处理机,2006-2:33
[35]赵永勇,张永健.基于Video4Linux的视频图像采集实现.电脑编程与技巧,2006-5:75
[36]戴丽,张维勇,刘征宇.嵌入式无线视频监控系统的设计与实现.合肥工业大学学报(自然科学版),2008-1:7-8
[37]鲁宏伟等.多媒体计算机原理与应用[M].北京:清华大学出版社,2006-5
[38]钟玉琢等.多媒体计算机技术基础及应用(第2版)[M].高等教育出版社,2005-1
[39]Lihong Xu,Shuhua Ai.A New Feedback Control Strategy of Video Transmission Based on RTP.2006 IEEE
[40]赵进.RTP/RTCP流媒体服务器技术研究.http://www.lmtw.com/Article/glossary/200402/1973.html
[41]H.Schulzrinne,A.Rao,R.Lanphier.Real Time Streaming Protocol(RTSP).http://www.cs.columbia.edu/～hgs/rtsp/draft/draft-ietf-mmusic-rtsp-09.pdf
[42]Jori Liesenborgs.JRTPLIB.http://research.edm.uhasselt.be/jori/jrtplib/documentation/index.html
[43]陈小平,王皖陵.Linux下实时流媒体编程实现.安徽工业大学学报,2005-7:294-297
[44]安徽华恒科技有限公司.HHARM2410-STUDY_tech_manual-v1.1
[2]Zhao Jian Wang Haili Li Bo.Research and Realize the Key Technology of the Soft System For Instrument Platform Based on the Embedded Linux.The Eighth International Conference on Electronic Measurement and Instruments,2007:2-426
[3]李善平,刘文峰,王焕龙等.Linux与嵌入式系统(第2版).北京:清华大学出版社,2006-3
[4]Baker Mohammad,Paul Bassett,Jacob Abraham,and Adnan Aziz.CACHE ORGANIZATION FOR EMBEDED PROCESSORS:CAM-vs-SRAM.IEEE,2006:299
[5]John L.Hennessy,David A.Patterson.Computer Architecture:A Quantitative Approach,Third Edition.
[6]Alex Lennon.Embedding Linux.Embedded system.IEE REVIEW 2001:34-35
[7]Collins R,et al.A system for video surveillance and monitor:VASM final report.Carnegie Mellon University's Technical Report.2000
[8]第二届全国智能视觉监控学术会议即将在京举办.http://wwww.cas.cn/html/Dir/2003/12/05/6714.htm
[9]David A.Patterson,John L.Hennessy.Computer Organization and Design:The Hardware/Software Interface,Third Edition
[10]毛德操,胡希明.Linux内核源代码情景分析.杭州:浙江大学出版社,2001-9
[11]倪继利.Linux内核分析及编程.北京:电子工业出版社,2006-1
[12]Debian GNU/Linux Installation Guide.http://www.debian.org/releases/stable/i386/
[13]信息产业部软件与集成电路促进中心.Debian Linux系统配置与管理.北京:电子工业出版社,2006-1
[14]Karim Yaghmour.Building Embedded Linux Systems.O'REILLY
[15]夏明.基于Linux的嵌入式监控系统软件平台研究与设计:[硕士学位论文].南京理工大学控制理论与控制工程,2007
[16]Kyung Ho Chung,Myung Sil Choi,Kwang Seon Ahn.A Study on the Packaging for Fast Boot-up Time in the Embedded Linux.13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications(RTCSA 2007):1
[17]沈猛.基于HHARM9-EDU平台的嵌入式操作系统引导程序的设计.电脑知识与技术,2005:120
[18]孙天泽,袁文菊,张海峰.嵌入式设计及LINUX驱动开发指南--基于ARM 9处理器.北京:电子工业出版社,2005-9
[19]张静,叶梧,冯穗力.基于ARM 920T的嵌入式Linux系统开发.现代电子技术,2005年第4期:23
[20]白伟平,包启亮.基于ARM的嵌入式Boot Loader浅析.微计算机信息,2006年第22卷:99
[21]PengLi,YuLu,HongxingWei.Realization of Embedded Multimedia System Based On Dual-Core Processor OMAP5910.IMACS Multiconference on "Computational Engineering in Systems Applications"(CESA),2006:101
[22]曾宏安,齐尧,焦振强等.用U-BOOT构建嵌入式系统的引导装载程序.单片机与嵌入式系统应用,2005.2:82-83
[23]http://www.davicom.com.tw/big5/download/Data%20Sheet/DM9000A-DS-F01-101906.pdf
[24]管秋梅,胡仁杰.基于嵌入式Linux的网络设备驱动设计与实现.电子工程师,2007-3:77
[25]Jonathan Corbet,Alessandro Rubini,Greg Kroah-Hartman,Linux Device Drivers,3rd Edition
[26]Jim Mellander,Lawrence Berkeley National Laboratory.Unix Filesystem Security.Information Security Technical Report,2002,Vol7,No.1:11
[27]潘巨龙,黄宁,姚伏天等.ARM9嵌入式Linux系统构建与应用.北京:北京航空航天大学,2006-8
[28]http://www.busybox.net/about.html
[29]孙辉,陆松年,杨树堂.基于Linux和S3c2410的嵌入式Web Server的研究与实现.计算机应用与软件,2007-2,Vol124,No.2:134
[30]Compaq,Hewlett-Packard,Intel.Universal Serial Bus Specification.2000-4:26
[31]张卓亮.基于Linux系统的USB HOST驱动程序设计与实现.中国集成电路,2007-11:30
[32]Agilent.Agilent CMOS Image Sensors HDCS-1020(CIF)and HDCS-2020(VGA)Product Brief.http://www.ortodoxism.ro/datasheets2/2/05jj45dcrga6zr0zjg7hrde83cpy.pdf
[33]刘文峰,李程远,李善平.嵌入式L inux操作系统的研究.浙江大学学报(工学版),2004-4:450
[34]李献霞,孟小锁.嵌入式系统源码调试器GDB的远程通信.微处理机,2006-2:33
[35]赵永勇,张永健.基于Video4Linux的视频图像采集实现.电脑编程与技巧,2006-5:75
[36]戴丽,张维勇,刘征宇.嵌入式无线视频监控系统的设计与实现.合肥工业大学学报(自然科学版),2008-1:7-8
[37]鲁宏伟等.多媒体计算机原理与应用[M].北京:清华大学出版社,2006-5
[38]钟玉琢等.多媒体计算机技术基础及应用(第2版)[M].高等教育出版社,2005-1
[39]Lihong Xu,Shuhua Ai.A New Feedback Control Strategy of Video Transmission Based on RTP.2006 IEEE
[40]赵进.RTP/RTCP流媒体服务器技术研究.http://www.lmtw.com/Article/glossary/200402/1973.html
[41]H.Schulzrinne,A.Rao,R.Lanphier.Real Time Streaming Protocol(RTSP).http://www.cs.columbia.edu/～hgs/rtsp/draft/draft-ietf-mmusic-rtsp-09.pdf
[42]Jori Liesenborgs.JRTPLIB.http://research.edm.uhasselt.be/jori/jrtplib/documentation/index.html
[43]陈小平,王皖陵.Linux下实时流媒体编程实现.安徽工业大学学报,2005-7:294-297
[44]安徽华恒科技有限公司.HHARM2410-STUDY_tech_manual-v1.1