基于S3C2440的嵌入式视频网络监控系统
|
摘要
IT技术特别是集成电路和IT技术的发展,使视频监控系统正由传统的基于模拟监控的模式向全数字模式发展,并越来越和网络和图像处理技术相结合。
本课题基于嵌入式系统设计了一种监控系统。本系统由视频服务器和后台客户监控端两部分组成。本系统采用ARM9系列处理器S3C2440作为MCU,并在其上移植嵌入式Linux做为软件开发平台。
由于当前监控系统的发展方向是以视频服务器为核心的第三代全数字化远程视频集中监控模式,而本系统顺应上述趋势采用网络和后台客户端连接。
本系统视频采集部分用CCD摄像头获取模拟视频信号,然后经由SAA7111进行AD转换,将其转换为YUV信号,并由ZR36060进行视频的压缩。
本系统有两种工作模式,无人抓拍模式和视频监控模式。两种模式都是采用Video4Linux API抓取图像。无人抓拍模式每隔0.5s抓取一帧原始bmp格式图像,打上时间标签并压缩为jpeg格式后将其存储至U盘(支持热插拔);连续视频监控模式将连续抓取到的jpeg格式图像帧数据通过网络传送至后台PC进行显示和视频文件的生成。这样一来,前端部分(摄像头和开发板)构成视频服务器,后台PC构成客户显示端,负责视频图像的显示和视频文件的生成。
后台PC端采用跨平台的用户界面开发工具Qt进行显示界面的编写,同时与音视频解决方案ffmpeg相结合,完成了视频图像的显示和视频文件的生成。由于所采用的工具都是跨平台的,所以后台程序具有很好的移植性。
这套智能监控系统与专业设备比较,价格低廉、安装简单、即插即用、一键操作,并且体积小巧。
With the development of IT and the technology of integrate circuit, the video monitoring system is going from traditional anolog monitoring mode to full-digitalized mode, it is combining the network and image processing technology more and more. However, some professional video monitoring system is always very expensive.
This paper introduces a video monitoring system based on embedded system, wich consists of two parts: the video server and the back PC client. We use S3C2440 which is an ARM9 processor as the controller, and make use of embedded Linux.
Nowadays, the trend of the monitoring system is that third generation of completely digitalized centralized monitoring mode whose core is visual server. So our system connects the server at the front end with the client at the back PC via net.
The video capturing interface in our system uses a camera to capture the analog video sigal. The analog signal will be converted into YUV digital signal by SAA7111, then it will be compressed by ZR36060.
There are two work modes in our system: unmanned-capturing mode and continual-video-monitoring mode. Both of the two modes use Video4Linux API to capture the images. The unmanned-capturing mode would capture one frame every half a second, then it will print the time stamp in the image and compress the image into Jpeg format. The continual-video-monitoring mode would send the continual frames to the back PC via net. The program in the back PC would display the continual frames and compress them into a video file. Thus, the devices in the front end (the camera and the ARM board) works as a video server while the program in the back PC works as the client which would display the continual frames and produce a video file.
We use Qt to code the user interface program. Qt is a popular development kit which is portable between in different platforms. And we produce the video file using ffmpeg which is a very excellent audio and video solution. Because all the kits we use are both portable, our program can run both in linux and windows platform.
Our system is low-cost and it is very convenient to set up the system.
本课题基于嵌入式系统设计了一种监控系统。本系统由视频服务器和后台客户监控端两部分组成。本系统采用ARM9系列处理器S3C2440作为MCU,并在其上移植嵌入式Linux做为软件开发平台。
由于当前监控系统的发展方向是以视频服务器为核心的第三代全数字化远程视频集中监控模式,而本系统顺应上述趋势采用网络和后台客户端连接。
本系统视频采集部分用CCD摄像头获取模拟视频信号,然后经由SAA7111进行AD转换,将其转换为YUV信号,并由ZR36060进行视频的压缩。
本系统有两种工作模式,无人抓拍模式和视频监控模式。两种模式都是采用Video4Linux API抓取图像。无人抓拍模式每隔0.5s抓取一帧原始bmp格式图像,打上时间标签并压缩为jpeg格式后将其存储至U盘(支持热插拔);连续视频监控模式将连续抓取到的jpeg格式图像帧数据通过网络传送至后台PC进行显示和视频文件的生成。这样一来,前端部分(摄像头和开发板)构成视频服务器,后台PC构成客户显示端,负责视频图像的显示和视频文件的生成。
后台PC端采用跨平台的用户界面开发工具Qt进行显示界面的编写,同时与音视频解决方案ffmpeg相结合,完成了视频图像的显示和视频文件的生成。由于所采用的工具都是跨平台的,所以后台程序具有很好的移植性。
这套智能监控系统与专业设备比较,价格低廉、安装简单、即插即用、一键操作,并且体积小巧。
With the development of IT and the technology of integrate circuit, the video monitoring system is going from traditional anolog monitoring mode to full-digitalized mode, it is combining the network and image processing technology more and more. However, some professional video monitoring system is always very expensive.
This paper introduces a video monitoring system based on embedded system, wich consists of two parts: the video server and the back PC client. We use S3C2440 which is an ARM9 processor as the controller, and make use of embedded Linux.
Nowadays, the trend of the monitoring system is that third generation of completely digitalized centralized monitoring mode whose core is visual server. So our system connects the server at the front end with the client at the back PC via net.
The video capturing interface in our system uses a camera to capture the analog video sigal. The analog signal will be converted into YUV digital signal by SAA7111, then it will be compressed by ZR36060.
There are two work modes in our system: unmanned-capturing mode and continual-video-monitoring mode. Both of the two modes use Video4Linux API to capture the images. The unmanned-capturing mode would capture one frame every half a second, then it will print the time stamp in the image and compress the image into Jpeg format. The continual-video-monitoring mode would send the continual frames to the back PC via net. The program in the back PC would display the continual frames and compress them into a video file. Thus, the devices in the front end (the camera and the ARM board) works as a video server while the program in the back PC works as the client which would display the continual frames and produce a video file.
We use Qt to code the user interface program. Qt is a popular development kit which is portable between in different platforms. And we produce the video file using ffmpeg which is a very excellent audio and video solution. Because all the kits we use are both portable, our program can run both in linux and windows platform.
Our system is low-cost and it is very convenient to set up the system.
引文
[1]家庭视频监控的技术趋势[Z]. http://www.sd110.cn/News/view
[2] Ffmpeg SDK开发手册[Z]
[3] Recommendation ITU-R BT.601-5: Studio encoding parameters of digital television for standard 4:3 and wide-screen 16:9 aspect ratios[S]. 1995
[4] Recommendation ITU-R BT.656-4: Interfaces for digital component video signals in 525-line and 625-line television systems operation at the 4:2:2 level of Recommendation ITU-R[S], Part A, 2003
[5]王田苗.嵌入式系统设计与实例开发——基于ARM微处理器与uC/OS-II实时操作系统[M].北京:清华大学出版社,2003.10.
[6]周立功. ARM嵌入式系统基础教程[M].北京:北京航空航天大学出版社,2005.1. 20~23.
[7]杜春雷. ARM体系结构与编程[M].北京:清华大学出版社,2003.2. 26~38.
[8] Samsung Electronics. S3C2440A 32-bit CMOS Microcontroller User’s Manual[S]. Revision 1
[9]何永威.基于嵌入式Linux的家用智能监控系统[D].上海交通大学硕士学位论文. 2007.2
[10] Samsung Electronics. K4S561632D 256Mbit SDRAM 4M x 16bit x 4 Banks Synchronous DRAM LVTTL Revision 0.1[S], 2002. 11~16
[11]杨继华.基于嵌入式Linux的远程图像监控系统[D].华中科技大学硕士学位论文. 2005.4
[12]王艳超,赵金宪.视频解码器SAA7111在图像采集中的应用.中电网. 2008.7
[13] Philips. SAA7111 Video Input Processor(VIP) Product specification[S] 1996.10.30
[14]彭加进.基于JPEG图像压缩的嵌入式视频采集处理系统[D]河海大学硕士学位论文. 2007.3
[15] Philips. The I2C-Bus Specification[S]. www.philips.com
[16] Zoran. ZR36060 Integrated JPEG Codec Data Sheet[D]. www.alldatasheet.com/datasheet-pdf
[17] BISS 0001系列热释电红外探测器说明书[P].上海京西电子信息系统有限公司. 2006.12
[18] Jonathan Corbet, Alessandro Rubini & Greg Kroah-Hartman. Linux Device Drivers ThirdEdition[M]. O’reilly, 2005.11.
[19] Robert Love. Linux Kernel Development Second Edition[M]. Pearson Education Publisher, 2007.12.
[20] Kernel v2.6.16-git20 /Documentation/video4linux/Zoran[Z] www.linuxhq.com/kernel/v2.6/16-git20/Documentation/video4linux/Zoran
[21] Use saa7111 i2c module in V4L MXB driver[Z] http://linux.derkeiler.com/Mailing-Lists/Kernel/2004-05/4698.html
[22] Alan Cox. Video4Linux Programming[M]. alan@redhat.com, 2000. 31~32
[23] W.RICHARD STEVENS,STEPHEN A.RAGO. ADVANCED PROGRAMMING IN THE UNIX ENVIRONMENT[M]人民邮电出版社2006.5
[24]蔡士杰,岳华.连续色调静止图像的压缩与编码—JEPG[M].南京:南京大学出版社,1994
[25]马小虎,张明敏,严华明.多媒体数据压缩标准及实现[M].北京:清华大学出版社,1996.8
[26] W.RICHARD STEVENS. TCP/IP详解卷1:协议[M].机械工业出版社. 2000.12
[27] W.RICHARD STEVENS, BILL FENNER , ANDREW M. RUDOFF , RICHARD W.STEVENS. UNIX网络编程第1卷:套接口API(第3版)[M].北京:清华大学出版社,2006.11
[28] Ffmpeg技术[Z]. http://www.ffmpeg.com.cn
[29] Gasmin Blanchette, Mark Summerfield. C++ GUI Qt 3编程[M].北京航空航天大学, 2006.8. 3-9
[30] Qt参考文档[Z] http://www.qtopia.org.cn/doc/qiliang.net/qt/index.html
[31]吴桂祥.应用于网络视频监控系统的嵌入式视频采集与GUI设计[D].浙江大学硕士学位论文. 2007.5
[32]陈晓敏,王学进,王志华,张利. JPEG编解码芯片ZR36060在远程视频监控系统中的应用[J]: www.cediy.com. 2005.8
[33]朱磊,陆亨立.基于ASIC设计的图像采集系统的实现[J]:微计算机信息. 2005年第21卷第2期. 160-161
[34]田文.嵌入式网络视频监控系统的研究与实现[D].电子科技大学硕士学位论文. 2005
[35]田泽.嵌入式系统开发与应用教程[M].北京:北京航空航天大学出版社,2005.3.
[36]樊振萍,唐继勇.基于RTP协议和MPEG-4的流媒体系统分析与实现[C]西部广播网2006.11
[37]钱建良.基于DVR的网络化家庭视频监控系统[P].北京合众达电子技术有限责任公司, 2006.6
[2] Ffmpeg SDK开发手册[Z]
[3] Recommendation ITU-R BT.601-5: Studio encoding parameters of digital television for standard 4:3 and wide-screen 16:9 aspect ratios[S]. 1995
[4] Recommendation ITU-R BT.656-4: Interfaces for digital component video signals in 525-line and 625-line television systems operation at the 4:2:2 level of Recommendation ITU-R[S], Part A, 2003
[5]王田苗.嵌入式系统设计与实例开发——基于ARM微处理器与uC/OS-II实时操作系统[M].北京:清华大学出版社,2003.10.
[6]周立功. ARM嵌入式系统基础教程[M].北京:北京航空航天大学出版社,2005.1. 20~23.
[7]杜春雷. ARM体系结构与编程[M].北京:清华大学出版社,2003.2. 26~38.
[8] Samsung Electronics. S3C2440A 32-bit CMOS Microcontroller User’s Manual[S]. Revision 1
[9]何永威.基于嵌入式Linux的家用智能监控系统[D].上海交通大学硕士学位论文. 2007.2
[10] Samsung Electronics. K4S561632D 256Mbit SDRAM 4M x 16bit x 4 Banks Synchronous DRAM LVTTL Revision 0.1[S], 2002. 11~16
[11]杨继华.基于嵌入式Linux的远程图像监控系统[D].华中科技大学硕士学位论文. 2005.4
[12]王艳超,赵金宪.视频解码器SAA7111在图像采集中的应用.中电网. 2008.7
[13] Philips. SAA7111 Video Input Processor(VIP) Product specification[S] 1996.10.30
[14]彭加进.基于JPEG图像压缩的嵌入式视频采集处理系统[D]河海大学硕士学位论文. 2007.3
[15] Philips. The I2C-Bus Specification[S]. www.philips.com
[16] Zoran. ZR36060 Integrated JPEG Codec Data Sheet[D]. www.alldatasheet.com/datasheet-pdf
[17] BISS 0001系列热释电红外探测器说明书[P].上海京西电子信息系统有限公司. 2006.12
[18] Jonathan Corbet, Alessandro Rubini & Greg Kroah-Hartman. Linux Device Drivers ThirdEdition[M]. O’reilly, 2005.11.
[19] Robert Love. Linux Kernel Development Second Edition[M]. Pearson Education Publisher, 2007.12.
[20] Kernel v2.6.16-git20 /Documentation/video4linux/Zoran[Z] www.linuxhq.com/kernel/v2.6/16-git20/Documentation/video4linux/Zoran
[21] Use saa7111 i2c module in V4L MXB driver[Z] http://linux.derkeiler.com/Mailing-Lists/Kernel/2004-05/4698.html
[22] Alan Cox. Video4Linux Programming[M]. alan@redhat.com, 2000. 31~32
[23] W.RICHARD STEVENS,STEPHEN A.RAGO. ADVANCED PROGRAMMING IN THE UNIX ENVIRONMENT[M]人民邮电出版社2006.5
[24]蔡士杰,岳华.连续色调静止图像的压缩与编码—JEPG[M].南京:南京大学出版社,1994
[25]马小虎,张明敏,严华明.多媒体数据压缩标准及实现[M].北京:清华大学出版社,1996.8
[26] W.RICHARD STEVENS. TCP/IP详解卷1:协议[M].机械工业出版社. 2000.12
[27] W.RICHARD STEVENS, BILL FENNER , ANDREW M. RUDOFF , RICHARD W.STEVENS. UNIX网络编程第1卷:套接口API(第3版)[M].北京:清华大学出版社,2006.11
[28] Ffmpeg技术[Z]. http://www.ffmpeg.com.cn
[29] Gasmin Blanchette, Mark Summerfield. C++ GUI Qt 3编程[M].北京航空航天大学, 2006.8. 3-9
[30] Qt参考文档[Z] http://www.qtopia.org.cn/doc/qiliang.net/qt/index.html
[31]吴桂祥.应用于网络视频监控系统的嵌入式视频采集与GUI设计[D].浙江大学硕士学位论文. 2007.5
[32]陈晓敏,王学进,王志华,张利. JPEG编解码芯片ZR36060在远程视频监控系统中的应用[J]: www.cediy.com. 2005.8
[33]朱磊,陆亨立.基于ASIC设计的图像采集系统的实现[J]:微计算机信息. 2005年第21卷第2期. 160-161
[34]田文.嵌入式网络视频监控系统的研究与实现[D].电子科技大学硕士学位论文. 2005
[35]田泽.嵌入式系统开发与应用教程[M].北京:北京航空航天大学出版社,2005.3.
[36]樊振萍,唐继勇.基于RTP协议和MPEG-4的流媒体系统分析与实现[C]西部广播网2006.11
[37]钱建良.基于DVR的网络化家庭视频监控系统[P].北京合众达电子技术有限责任公司, 2006.6