基于嵌入式Linux的数字视频监控系统研究
|
摘要
近年来,随着网络和多媒体技术的飞速发展,网络视频被越来越多的应用于各个方面。监控技术领域就是其中之一,它正在向数字化、网络化、智能化的方向发展,出现了利用IP网络实现远程视频监控的趋势,把模拟的视频监控信号转化为数字信号引入互联网,即可实现随时随地的监控功能,不再受距离等方面的限制。这里面的核心部分就是一个可以直接连入以太网的视频采集设备,提供实时的图像采集、压缩和传输的功能。
本课题根据海上航行的客轮、油轮等船舶的关键部位的视频监控,海事执法现场与指挥中心视频实时互动的需求,针对海上船舶的实际情况和现今技术的发展,提出了一种基于嵌入式Linux的视频解决方案。
根据系统设计的要求,我选择了ST2410硬件平台和嵌入式Linux操作系统进行开发,实现了视频图像在开发平台的实时显示,并对USB摄像头视频数据压缩和网络传输进行了比较详细的分析和研究。实现了一种方便且成本低廉的实时图像采集和传输设备的设计方案。
论文的主要工作包括:嵌入式Linux系统设计与实现,其中包括搭建嵌入式Linux开发平台(主机和目标机),裁减定制Linux内核,Bootloader的设计与实现,创建配置cramfs根文件系统。USB摄像头驱动实现,Video4Linux(Video4Linux是Linux下用于获取视频和音频数据的API接口)下摄像头图像采集。Qt/Embedded开发环境搭建,Qtopia的移植,Qt界面图像显示程序,实现了嵌入式系统视频采集及显示的功能并对网络视频领域相关技术进行了研究。最后对该嵌入式视频采集设备进行了应用测试和评价,并对该课题的后续工作进行了展望。
Nowadays, with the rapid development of the Internet and multi-media technology, Internet video system has more and more been widely put into use in our life. Video-monitoring system is one of the examples, which is advancing digitally, networkingly and intelligently. There is a trend that no matter what the distance is, real-time monitoring can be implemented using IP network, changing analogue video signal into digital signal. The core is a video capture device directly connected to the Internet, with the function of real-time video capture, compression and transmission.
Considering the present situation of ships and the development of current technology, this research work offers a solution to the real-time video monitoring based on Embedded System, for such requirement is called on for key parts of sailing passenger liners or oil tankers and maritime enforcement.
According to the design requirement, ST2410 hardware platform and Embedded Linux Operating System are chosen to be experimented, implementing the real-time display of the video pictures on the development platform. Video data compression of USB digital camera and the Internet transmission are carefully analyzed and studied as well. Thus, a design of a convenient and economical device on real-time video capture and transmission is realized.
This dissertation first introduces the design and implementation of the technology of Embedded Linux System, including the following research work—establishing the platform of Embedded Linux (PC and target PC), cutting and customizing Linux core, designing and implementing bootloader and producing and configuring Root file system. And then it deals with the implementation of the USB camera driver and the picture collection of the camera based on Video4Linux. Besides, the dissertation also involves the establishment of Qtopia, the display of the program with Qt interface, the realization of picture collection and display based on Embedded Linux System and the researches into related technology on the Internet video system. Finally, the experiment results are analyzed and evaluated and the future research targets are mentioned based on the current project.
本课题根据海上航行的客轮、油轮等船舶的关键部位的视频监控,海事执法现场与指挥中心视频实时互动的需求,针对海上船舶的实际情况和现今技术的发展,提出了一种基于嵌入式Linux的视频解决方案。
根据系统设计的要求,我选择了ST2410硬件平台和嵌入式Linux操作系统进行开发,实现了视频图像在开发平台的实时显示,并对USB摄像头视频数据压缩和网络传输进行了比较详细的分析和研究。实现了一种方便且成本低廉的实时图像采集和传输设备的设计方案。
论文的主要工作包括:嵌入式Linux系统设计与实现,其中包括搭建嵌入式Linux开发平台(主机和目标机),裁减定制Linux内核,Bootloader的设计与实现,创建配置cramfs根文件系统。USB摄像头驱动实现,Video4Linux(Video4Linux是Linux下用于获取视频和音频数据的API接口)下摄像头图像采集。Qt/Embedded开发环境搭建,Qtopia的移植,Qt界面图像显示程序,实现了嵌入式系统视频采集及显示的功能并对网络视频领域相关技术进行了研究。最后对该嵌入式视频采集设备进行了应用测试和评价,并对该课题的后续工作进行了展望。
Nowadays, with the rapid development of the Internet and multi-media technology, Internet video system has more and more been widely put into use in our life. Video-monitoring system is one of the examples, which is advancing digitally, networkingly and intelligently. There is a trend that no matter what the distance is, real-time monitoring can be implemented using IP network, changing analogue video signal into digital signal. The core is a video capture device directly connected to the Internet, with the function of real-time video capture, compression and transmission.
Considering the present situation of ships and the development of current technology, this research work offers a solution to the real-time video monitoring based on Embedded System, for such requirement is called on for key parts of sailing passenger liners or oil tankers and maritime enforcement.
According to the design requirement, ST2410 hardware platform and Embedded Linux Operating System are chosen to be experimented, implementing the real-time display of the video pictures on the development platform. Video data compression of USB digital camera and the Internet transmission are carefully analyzed and studied as well. Thus, a design of a convenient and economical device on real-time video capture and transmission is realized.
This dissertation first introduces the design and implementation of the technology of Embedded Linux System, including the following research work—establishing the platform of Embedded Linux (PC and target PC), cutting and customizing Linux core, designing and implementing bootloader and producing and configuring Root file system. And then it deals with the implementation of the USB camera driver and the picture collection of the camera based on Video4Linux. Besides, the dissertation also involves the establishment of Qtopia, the display of the program with Qt interface, the realization of picture collection and display based on Embedded Linux System and the researches into related technology on the Internet video system. Finally, the experiment results are analyzed and evaluated and the future research targets are mentioned based on the current project.
引文
[1]孙文力、孙文强编著.船载自动识别系统.大连:大连海事大学出版社,2004.
[2]卢军编著,Linux0.01内核分析与操作系统设计--创造你自己的操作系统,北京:清华大学出版社,2004.
[3]陈渝、李明、杨晔等编著,源码开放的嵌入式系统软件分析与实践,北京:北京航空航天大学出版社,2004.
[4]Douglass,B.P.Doing Hard Time--Developing Real--Time Systems with UML,Objects,Frameworks and Patterns,Addison-Wesley,1999.
[5]G.Martin,L.Lavagno,J.Louis--Guerin,Embedded UML:a merger of real-time UML and co--design,Proceedings of CODES 2001,Copenhagen,April 2001,pp.23-28.
[6]Edward A.Lee(Embedded Software)London:Academic Press 2002.
[7]Artisan Software,"Real-Time Studio:The Rational Alternative",white paper,version 3.0,29 July 1999,URL:http://www.artisansw.com/whitepapers.
[8]马忠梅、马广云、徐英慧、田泽编著,ARM嵌入式处理器结构与应用基础,北京航空航天大学出版社,2002
[9](美)Michael Jang著邱仲潘等译,红帽Linux 9从入门到精通,北京:电子工业出版社,2003
[10](美)Syed Mansoor Sarwar Robert Koretsky Syed Aqeel Sarwar著李善平,施韦,林欣等译,Linux教程,北京:清华大学出版社,2005.
[11]刘峥嵘、张智超、许振山等编著,嵌入式Linux应用开发详解,北京:机械工业出版社2004
[12]邹思轶主编,嵌入式Linux设计与应用,北京:清华大学出版社2002
[13]John M.Gauch,Susan Gauch,Sylvain Bouix,Xiaolan Zhu.Real timevideo scene detection and classification.Information Processing and Management.1999
[14]Hamid R.Sheikh,Brian L.Evans,Alan C.Bovik.Real-time foveation techniques for low bit rate video coding.Real-Time Imaging 9(2003)27-40
[15]Minerva Yeungy,Boon-Lock Yeoz.Segmentation of Video by Clustering and Graph Analysis.COMPUTER VISION AND IMAGE UNDERSTANDING,Vol.71,No.1,July,pp.94-109,1998
[16]http://www.linuxfans.org/nuke/modules.php?name=Forums&file=viewtopic&t=11275,2005
[17]刘富强编著,数字视频监控系统开发与应用,北京:机械工业出版社,2003.
[18](美)K.Wall等著王勇等译,GNU/Linux编程指南北京,北京:清华大学出版社2000
[19]刘淼编著,嵌入式系统接口设计与Linux驱动程序开发,北京:北京航空航天大学出版社,2006.
[20]魏洪兴、胡亮、曲学楼编著,嵌入式系统设计与实例开发试验教材Ⅱ--基于ARM9微处理器与Linux操作系统,清华大学出版社,2005.
[21]孙琼编著,嵌入式Linux应用程序开发详解,北京:人民邮电出版社,2006.
[22](美)Tom Swan著邱仲潘等译,深入学习:GNU C++for Linux编程技术,北京:电子工业出版社2000.
[23]MjchaelBeck等著,Linux 内核编程指南(第3版),清华大学出版社2004.
[24]Xtearn(中国)软件技术有限公司编著,Qt程序设计,北京:清华大学出版社,2002.
[25](美)[E.哈洛]Eric Harlow著董寿彬等译,用GTK+和GDK开发Linux图形用户界面应用,北京:电子工业出版社2000.
[26](美)Andrew N.Sloss、(英)Dominic Symes、(美)Chris Wright等著沈建华译.ARM嵌入式系统开发—一软件设计与优化,北京:北京航空航天大学出版社,2005.
[27]杜春雷编著,ARM体系结构与编程,北京:清华大学出版社,2003.
[28]袁毅,基于嵌入式Web服务器的网络视频监控,电网技术,2000.
[29]江潮、苏祥芳、刘立海、牟旭东等编著,基于网络的数字视频监控系统,武汉大学学报(自然科学版)2000,10.
[30]邹宪民、温惠英编著,数字监控系统在技防工程中的应用,交通与计算机,2001,6.
[31]杨小平,牛秦洲.嵌入式系统网络接口模块设计[J].桂林工学院学报,2005年1月,第25卷
[32]龚仕伟,许锦标,廖翔云.基于嵌入式Web服务器的远程视频监控系统.电工技术杂志,2003年第1期
[33]顾永建,高守乐.基于嵌入式系统的网络数字视频监控系统.计算机技术与应用,2005年第1期
[34]马毅.基于Linux的远程视频监控嵌入式系统的设计与实现[学位论文].上海:上海交通大学计算机应用专业,2001,1.
[35]路林吉,吕新荣.用于数字监控的图像压缩技术.上海:上海交大信息学院.2003
[36]Jonathan Corbet等.Linux设备驱动程序第二版[M].北京:中国电力出版社,2006.
[37]SAMSUNG Electronics.S3C2410 User Manual[EB/OL].(2006-01-10)
[38]http://www.Samsung.com/ProductsiSemiconductor/MobileSoC!ApplicationYrocessor/ARM9S eries/S3C2410/S3C2410.htin.
[39]浩亮,张圣华.基于SpcaSxx-LE的网络图像实时采集系统的设计与实现[J].机电工程技术,2006 5(10):60-63.
[2]卢军编著,Linux0.01内核分析与操作系统设计--创造你自己的操作系统,北京:清华大学出版社,2004.
[3]陈渝、李明、杨晔等编著,源码开放的嵌入式系统软件分析与实践,北京:北京航空航天大学出版社,2004.
[4]Douglass,B.P.Doing Hard Time--Developing Real--Time Systems with UML,Objects,Frameworks and Patterns,Addison-Wesley,1999.
[5]G.Martin,L.Lavagno,J.Louis--Guerin,Embedded UML:a merger of real-time UML and co--design,Proceedings of CODES 2001,Copenhagen,April 2001,pp.23-28.
[6]Edward A.Lee(Embedded Software)London:Academic Press 2002.
[7]Artisan Software,"Real-Time Studio:The Rational Alternative",white paper,version 3.0,29 July 1999,URL:http://www.artisansw.com/whitepapers.
[8]马忠梅、马广云、徐英慧、田泽编著,ARM嵌入式处理器结构与应用基础,北京航空航天大学出版社,2002
[9](美)Michael Jang著邱仲潘等译,红帽Linux 9从入门到精通,北京:电子工业出版社,2003
[10](美)Syed Mansoor Sarwar Robert Koretsky Syed Aqeel Sarwar著李善平,施韦,林欣等译,Linux教程,北京:清华大学出版社,2005.
[11]刘峥嵘、张智超、许振山等编著,嵌入式Linux应用开发详解,北京:机械工业出版社2004
[12]邹思轶主编,嵌入式Linux设计与应用,北京:清华大学出版社2002
[13]John M.Gauch,Susan Gauch,Sylvain Bouix,Xiaolan Zhu.Real timevideo scene detection and classification.Information Processing and Management.1999
[14]Hamid R.Sheikh,Brian L.Evans,Alan C.Bovik.Real-time foveation techniques for low bit rate video coding.Real-Time Imaging 9(2003)27-40
[15]Minerva Yeungy,Boon-Lock Yeoz.Segmentation of Video by Clustering and Graph Analysis.COMPUTER VISION AND IMAGE UNDERSTANDING,Vol.71,No.1,July,pp.94-109,1998
[16]http://www.linuxfans.org/nuke/modules.php?name=Forums&file=viewtopic&t=11275,2005
[17]刘富强编著,数字视频监控系统开发与应用,北京:机械工业出版社,2003.
[18](美)K.Wall等著王勇等译,GNU/Linux编程指南北京,北京:清华大学出版社2000
[19]刘淼编著,嵌入式系统接口设计与Linux驱动程序开发,北京:北京航空航天大学出版社,2006.
[20]魏洪兴、胡亮、曲学楼编著,嵌入式系统设计与实例开发试验教材Ⅱ--基于ARM9微处理器与Linux操作系统,清华大学出版社,2005.
[21]孙琼编著,嵌入式Linux应用程序开发详解,北京:人民邮电出版社,2006.
[22](美)Tom Swan著邱仲潘等译,深入学习:GNU C++for Linux编程技术,北京:电子工业出版社2000.
[23]MjchaelBeck等著,Linux 内核编程指南(第3版),清华大学出版社2004.
[24]Xtearn(中国)软件技术有限公司编著,Qt程序设计,北京:清华大学出版社,2002.
[25](美)[E.哈洛]Eric Harlow著董寿彬等译,用GTK+和GDK开发Linux图形用户界面应用,北京:电子工业出版社2000.
[26](美)Andrew N.Sloss、(英)Dominic Symes、(美)Chris Wright等著沈建华译.ARM嵌入式系统开发—一软件设计与优化,北京:北京航空航天大学出版社,2005.
[27]杜春雷编著,ARM体系结构与编程,北京:清华大学出版社,2003.
[28]袁毅,基于嵌入式Web服务器的网络视频监控,电网技术,2000.
[29]江潮、苏祥芳、刘立海、牟旭东等编著,基于网络的数字视频监控系统,武汉大学学报(自然科学版)2000,10.
[30]邹宪民、温惠英编著,数字监控系统在技防工程中的应用,交通与计算机,2001,6.
[31]杨小平,牛秦洲.嵌入式系统网络接口模块设计[J].桂林工学院学报,2005年1月,第25卷
[32]龚仕伟,许锦标,廖翔云.基于嵌入式Web服务器的远程视频监控系统.电工技术杂志,2003年第1期
[33]顾永建,高守乐.基于嵌入式系统的网络数字视频监控系统.计算机技术与应用,2005年第1期
[34]马毅.基于Linux的远程视频监控嵌入式系统的设计与实现[学位论文].上海:上海交通大学计算机应用专业,2001,1.
[35]路林吉,吕新荣.用于数字监控的图像压缩技术.上海:上海交大信息学院.2003
[36]Jonathan Corbet等.Linux设备驱动程序第二版[M].北京:中国电力出版社,2006.
[37]SAMSUNG Electronics.S3C2410 User Manual[EB/OL].(2006-01-10)
[38]http://www.Samsung.com/ProductsiSemiconductor/MobileSoC!ApplicationYrocessor/ARM9S eries/S3C2410/S3C2410.htin.
[39]浩亮,张圣华.基于SpcaSxx-LE的网络图像实时采集系统的设计与实现[J].机电工程技术,2006 5(10):60-63.