基于MPEG-4的嵌入式远程视频监控系统的设计
|
摘要
随着信息技术和计算机互联网技术的飞速发展,网络化的视频监控技术已经广泛的得到了人们的关注,并得到了广泛的应用。凡是网络能够到达的地方就能通过网络视频监控技术进行远程的视频监控。
视频信息是人类获取信息的最主要载体,而人类获取信息中70%来自于视觉。由于视频信息经数字化处理后具有很强的抗干扰能力、易于加密等优点,因此在监控方面得到了广泛的应用。但是由于数字化的视频信息对存储和传输有很高的要求,因此视频信息的压缩编码对存储和传输视频信息具有重要的意义。而视频信息的压缩以及压缩后视频信息的传输是视频监控的核心技术,目前压缩视频的编码方法主要有:H.263、H.264、以及MPEG-4等,本文采用的是MPEG-4视频编码。同时采用RTP/RTCP实时传输协议对视频流进行网络传输。
本文在嵌入式Linux的ARM9平台上实现网络视频监控,主要完成的是服务器端的各部分功能。流程大致如下:首先利用USB摄像头采集数字图像,然后把采集到的视频信息传输到具有ARM920T核的S3C2410芯片进行MPEG-4视频压缩,接着把压缩后的视频流打包成RTP数据包进行网络传输。主要的工作有嵌入式平台的建立以及各个功能模块的程序实现。而功能模块主要包括视频采集模块、视频编码模块、视频传输模块。
嵌入式系统平台的构建主要包括系统硬件平台的设计和系统软件平台的搭建。硬件平台的设计主要有:了解处理器S3C2410的体系结构,USB接口电路的设计,网络接口的设计,存储器电路的设计,电源部分的设计等;系统软件平台的搭建主要包括:宿主机交叉编译环境的建立;BootLoader的移植;嵌入式Linux内核的裁剪与移植以及yaffs文件系统的建立。
在视频采集模块中,首先在Linux内核加载摄像头芯片的驱动和Linux的应用程序接口Video4Linux;然后利用Video4Linux,通过USB摄像头进行视频采集。
在视频编码模块中,采用的是最新的MPEG-4codec—XVID进行视频编码的。主要是把XVID生成静态链接库,然后移植到ARM中,通过编写应用程序实现对视频信号的MPEG-4视频编码。
在视频传输模块中,首先是对编码的MPEG-4码流进行打包,然后利用多媒体的实时传输协议RTP和实时传输控制协议RTCP对视频流进行网络传输。
With the rapid development of information technologies and computer network technology, remote video surveillance based on network is in extensive consideration of people, and have been widely used. With this technology, anywhere a network is connected, a user can acquire video data and monitor the status of equipments in long distance.
As is known to all, video information is the main carrier that the people get the information. And 70%'s information that the people get was from the video information. As the digital signal process of the video information, the information will have many merits, such as good anti-jamming, facility encryption. Therefore the video information has been widely used in video surveillance. However, because of the video information have a high demand in storage and information transmission, Video compression play a good part on it. And video compression and transmission of compressed video information are the core technology of video surveillance. Currently, the main video encode method have H.263, H.264 and MPEG-4, etc. This paper is based on MPEG-4 video encode, and using RTP / RTCP Real-time Transport Protocol to transmit the video streaming on network.
In this paper, we realize the function of the network video surveillance on service side, base on the embedded Linux system on ARM9 platform. The main process is as follow: firstly, use the USB digital camera to capture the image, and then put the video information into the S3C2410 microcontroller, and then encode the video information; at last, package the compressed video information into RTP packet, and then translate into the Internet. this paper have built the platform for embedded system development and realized three main function modules which include the video capture module, video encode module and the video transmission module.
Construct the embedded system platform include designing of the hardware platform and building the system software platform. Hardware platform design includes: understand the S3C2410 microcontroller architecture, USB interface circuit design, network interface design, the memory circuit design, power design. And the system software platform includes: establish the cross-compiler environment on the host machine, transplant the BootLoader and the Linux kernel on the ARM, build the yaffs file system.
In the video capture modules, Firstly, loader the camera chip driver and the Linux Application Programming Interface-Video4Linux in the Linux kernel, and then we use the USB camera to capture video data with the Video4Linux.
In the video coding module, we use the latest MPEG-4 codec—XVID to encode video data. mainly to generate the static link library for XVID, and then transplanted to ARM, and then through writing applications to achieve the MPEG-4 video coding for video signals.
In the video transmission module, firstly to encode the MPEG-4 package streams, and then use the real-time transmission protocol RTP of multimedia and real-time transmission control protocol RTCP to transmit the video stream.
视频信息是人类获取信息的最主要载体,而人类获取信息中70%来自于视觉。由于视频信息经数字化处理后具有很强的抗干扰能力、易于加密等优点,因此在监控方面得到了广泛的应用。但是由于数字化的视频信息对存储和传输有很高的要求,因此视频信息的压缩编码对存储和传输视频信息具有重要的意义。而视频信息的压缩以及压缩后视频信息的传输是视频监控的核心技术,目前压缩视频的编码方法主要有:H.263、H.264、以及MPEG-4等,本文采用的是MPEG-4视频编码。同时采用RTP/RTCP实时传输协议对视频流进行网络传输。
本文在嵌入式Linux的ARM9平台上实现网络视频监控,主要完成的是服务器端的各部分功能。流程大致如下:首先利用USB摄像头采集数字图像,然后把采集到的视频信息传输到具有ARM920T核的S3C2410芯片进行MPEG-4视频压缩,接着把压缩后的视频流打包成RTP数据包进行网络传输。主要的工作有嵌入式平台的建立以及各个功能模块的程序实现。而功能模块主要包括视频采集模块、视频编码模块、视频传输模块。
嵌入式系统平台的构建主要包括系统硬件平台的设计和系统软件平台的搭建。硬件平台的设计主要有:了解处理器S3C2410的体系结构,USB接口电路的设计,网络接口的设计,存储器电路的设计,电源部分的设计等;系统软件平台的搭建主要包括:宿主机交叉编译环境的建立;BootLoader的移植;嵌入式Linux内核的裁剪与移植以及yaffs文件系统的建立。
在视频采集模块中,首先在Linux内核加载摄像头芯片的驱动和Linux的应用程序接口Video4Linux;然后利用Video4Linux,通过USB摄像头进行视频采集。
在视频编码模块中,采用的是最新的MPEG-4codec—XVID进行视频编码的。主要是把XVID生成静态链接库,然后移植到ARM中,通过编写应用程序实现对视频信号的MPEG-4视频编码。
在视频传输模块中,首先是对编码的MPEG-4码流进行打包,然后利用多媒体的实时传输协议RTP和实时传输控制协议RTCP对视频流进行网络传输。
With the rapid development of information technologies and computer network technology, remote video surveillance based on network is in extensive consideration of people, and have been widely used. With this technology, anywhere a network is connected, a user can acquire video data and monitor the status of equipments in long distance.
As is known to all, video information is the main carrier that the people get the information. And 70%'s information that the people get was from the video information. As the digital signal process of the video information, the information will have many merits, such as good anti-jamming, facility encryption. Therefore the video information has been widely used in video surveillance. However, because of the video information have a high demand in storage and information transmission, Video compression play a good part on it. And video compression and transmission of compressed video information are the core technology of video surveillance. Currently, the main video encode method have H.263, H.264 and MPEG-4, etc. This paper is based on MPEG-4 video encode, and using RTP / RTCP Real-time Transport Protocol to transmit the video streaming on network.
In this paper, we realize the function of the network video surveillance on service side, base on the embedded Linux system on ARM9 platform. The main process is as follow: firstly, use the USB digital camera to capture the image, and then put the video information into the S3C2410 microcontroller, and then encode the video information; at last, package the compressed video information into RTP packet, and then translate into the Internet. this paper have built the platform for embedded system development and realized three main function modules which include the video capture module, video encode module and the video transmission module.
Construct the embedded system platform include designing of the hardware platform and building the system software platform. Hardware platform design includes: understand the S3C2410 microcontroller architecture, USB interface circuit design, network interface design, the memory circuit design, power design. And the system software platform includes: establish the cross-compiler environment on the host machine, transplant the BootLoader and the Linux kernel on the ARM, build the yaffs file system.
In the video capture modules, Firstly, loader the camera chip driver and the Linux Application Programming Interface-Video4Linux in the Linux kernel, and then we use the USB camera to capture video data with the Video4Linux.
In the video coding module, we use the latest MPEG-4 codec—XVID to encode video data. mainly to generate the static link library for XVID, and then transplanted to ARM, and then through writing applications to achieve the MPEG-4 video coding for video signals.
In the video transmission module, firstly to encode the MPEG-4 package streams, and then use the real-time transmission protocol RTP of multimedia and real-time transmission control protocol RTCP to transmit the video stream.
引文
[1]孙天泽,袁文菊,张海峰.嵌入式设计及Linux驱动开发指南——基于ARM9处理器(第二版)[M].电子工业出版社,2007年1月
[2]S3C2410A User's Manual Revision 1.0.Samsung Electronics Co.,Ltd.2004
[3]HY57V561620C(L)T(P)Synchronous DRAM Data sheet.Hynix Semiconductor Inc.June 2004
[4]K9F1208UOM Flash Memory Data sheet.Samsung Electronics Co.,Ltd.Oct.2004
[5]CS8900A Product Data Sheet.Cirrus Logic,Inc.2001
[6]陈峰,李滨滔,戈志华.基于S3C2410的嵌入式Linux系统构建[J].现代电子技术,2007年第24期
[7]陆宝辂,邵贝贝,李荐民.uClinux的设备驱动程序开发[J].单片机与嵌入式系统,2003年6月
[8]萧世文,宋延清.USB2.0硬件设计(第二版)[M].清华大学出版社,2006年10月
[9]Karim Yaghmour.Building Embedded Linux Systems[M].O'Reilly,April 2003
[10]OmniVision Technologies,Inc,OV7620 Data Sheet.2001
[11]OmniVision Technologies,Inc,OV511 Data Sheet.1998
[12]K.Wall,M.Watson,Whitis.GNU/LINUX编程指南[M].王勇,王一川,林华军,甘泉译 清华大学出版社 2000
[13]徐千洋.Linux C函数库参考手册[M].中国青年出版社,2002
[14]杜春雷.ARM体系结构与编程[M].清华大学出版社,2003
[15]王田苗.嵌入式系统设计与实例开发[M].清华大学出版社,2002
[16]Rafael C.Gonzalez,Richard E.Woods.阮秋琦,阮宇智译.数字图像处理(第二版)[M].电子工业出版社 2003年3月
[17]丁贵广,计文平,郭宝龙.Visual C++6.0数字图像编码[M].机械工业出版社,2004年2月
[18]钟玉琢,王琪,贺玉文.基于对象的多媒体数据压缩编码国际标准——MPEG4及其校验模型[M].科学出版社,2000
[19]MPEG-4 Overvier.ISO/IEC JTC1/SC29/WG11.1998
[20]Information technology of audio-visual objects-part1:System.ISO/IEC 14496-1.2001
[21]Information technology -Coding of audio-viaral objects-Part 2:Visual.ISO/IEC 14496-2.2001
[22]Information technology-Coding of audio-viaral objects-Part 12:ISO base media file format.ISO/IEC 14496-12.2005
[23]杨长生.图像与声音压缩技术[M].浙江大学出版社,2000
[24]周荫清.信息理论基础[M].北京航空航天大学出版社,1993
[25]余兆明,李晓飞,陈来春.MPEG标准及其应用[M].北京邮电大学出版社,2002
[26]Rao KR,Zoran S B,Dragorad AM1多媒体通信系统技术、标准及网络(影印版)[M].清华大学出版社,2003
[27]黄家传,王福豹,段渭军.MPEG-4的RTP封装技术及其应用[J].计算机应用研究,2005年8月
[28]许先斌.运用RTP协议实时传输MPEG-4流[J].计算机工程与设计,2003年2月
[29]董振亚,张拥军,彭宇行.基于RTP的MPEG-4视频传输[J].计算机应用研究 2003
[30]赵进,叶梧,冯穗力.基于RTP协议族的流媒体系统设计和实现[J].计算机工程 2005年1月
[31]刘玮.Visual C++视频/音频开发实用工程案例精选[M].北京人民邮电出版社,2004
[32]戴琦.基于ARM7TDMI和uCLinux的嵌入式MPEG4网络视频终端[D].浙江大学硕士论文,2005年3月
[33]《XVID core API overview》.http://www.xvid.org
[34]Richard M.Stallman,Roland McGrath,Paul D.Smith.GNU Make Version3.81.April 2006
[35]Basso A.,Varakliotis S.Transport of MPEG-4 over IP/RTP[C].IEEE International Conference,2000;(2):1067-1070
[36]A Transport Protocol for Real-Time Applications.RFC 1899.1996
[37]A Transport Protocol for Real-Time Applications.RFC3550.2003
[38]RTP Profile for Audio and Video Conferences with Minimal Control.RFC3551.2003
[39]RTP Payload Format for Transport of MPEG-4 Elementary Streams.RFC3640.2003
[40]RTP Payload Format for Transport of MPEG-4 Audio/Visual Streams.RFC3016.2000
[41]Jori Liesenborgs.JRTPLIB 3.5.2.March 26,2006
[42]林宇,郭凌云.Linux网络编程[M].人民邮电出版社.2000年6月
[43]羌春华.一种基于Internet的MPEG-4视频网络传输体系结构[D].东南大学硕士论文2002
[44]葛镜,张国平,王磊.基于DMIF体系的MPEG-4传输[J].有线电视技术.2006年12
[45]杨勇.MPEG-4基于VOP的视频分割及压缩算法研究[D].东南大学博士学位论文.2002
[46]Fred Halsall.多媒体通信[M].人民邮电出版社.2004年3月
[47]毛德操,胡希明.LINUX内核源代码情景分析[M].浙江大学出版社.2001年9月
[2]S3C2410A User's Manual Revision 1.0.Samsung Electronics Co.,Ltd.2004
[3]HY57V561620C(L)T(P)Synchronous DRAM Data sheet.Hynix Semiconductor Inc.June 2004
[4]K9F1208UOM Flash Memory Data sheet.Samsung Electronics Co.,Ltd.Oct.2004
[5]CS8900A Product Data Sheet.Cirrus Logic,Inc.2001
[6]陈峰,李滨滔,戈志华.基于S3C2410的嵌入式Linux系统构建[J].现代电子技术,2007年第24期
[7]陆宝辂,邵贝贝,李荐民.uClinux的设备驱动程序开发[J].单片机与嵌入式系统,2003年6月
[8]萧世文,宋延清.USB2.0硬件设计(第二版)[M].清华大学出版社,2006年10月
[9]Karim Yaghmour.Building Embedded Linux Systems[M].O'Reilly,April 2003
[10]OmniVision Technologies,Inc,OV7620 Data Sheet.2001
[11]OmniVision Technologies,Inc,OV511 Data Sheet.1998
[12]K.Wall,M.Watson,Whitis.GNU/LINUX编程指南[M].王勇,王一川,林华军,甘泉译 清华大学出版社 2000
[13]徐千洋.Linux C函数库参考手册[M].中国青年出版社,2002
[14]杜春雷.ARM体系结构与编程[M].清华大学出版社,2003
[15]王田苗.嵌入式系统设计与实例开发[M].清华大学出版社,2002
[16]Rafael C.Gonzalez,Richard E.Woods.阮秋琦,阮宇智译.数字图像处理(第二版)[M].电子工业出版社 2003年3月
[17]丁贵广,计文平,郭宝龙.Visual C++6.0数字图像编码[M].机械工业出版社,2004年2月
[18]钟玉琢,王琪,贺玉文.基于对象的多媒体数据压缩编码国际标准——MPEG4及其校验模型[M].科学出版社,2000
[19]MPEG-4 Overvier.ISO/IEC JTC1/SC29/WG11.1998
[20]Information technology of audio-visual objects-part1:System.ISO/IEC 14496-1.2001
[21]Information technology -Coding of audio-viaral objects-Part 2:Visual.ISO/IEC 14496-2.2001
[22]Information technology-Coding of audio-viaral objects-Part 12:ISO base media file format.ISO/IEC 14496-12.2005
[23]杨长生.图像与声音压缩技术[M].浙江大学出版社,2000
[24]周荫清.信息理论基础[M].北京航空航天大学出版社,1993
[25]余兆明,李晓飞,陈来春.MPEG标准及其应用[M].北京邮电大学出版社,2002
[26]Rao KR,Zoran S B,Dragorad AM1多媒体通信系统技术、标准及网络(影印版)[M].清华大学出版社,2003
[27]黄家传,王福豹,段渭军.MPEG-4的RTP封装技术及其应用[J].计算机应用研究,2005年8月
[28]许先斌.运用RTP协议实时传输MPEG-4流[J].计算机工程与设计,2003年2月
[29]董振亚,张拥军,彭宇行.基于RTP的MPEG-4视频传输[J].计算机应用研究 2003
[30]赵进,叶梧,冯穗力.基于RTP协议族的流媒体系统设计和实现[J].计算机工程 2005年1月
[31]刘玮.Visual C++视频/音频开发实用工程案例精选[M].北京人民邮电出版社,2004
[32]戴琦.基于ARM7TDMI和uCLinux的嵌入式MPEG4网络视频终端[D].浙江大学硕士论文,2005年3月
[33]《XVID core API overview》.http://www.xvid.org
[34]Richard M.Stallman,Roland McGrath,Paul D.Smith.GNU Make Version3.81.April 2006
[35]Basso A.,Varakliotis S.Transport of MPEG-4 over IP/RTP[C].IEEE International Conference,2000;(2):1067-1070
[36]A Transport Protocol for Real-Time Applications.RFC 1899.1996
[37]A Transport Protocol for Real-Time Applications.RFC3550.2003
[38]RTP Profile for Audio and Video Conferences with Minimal Control.RFC3551.2003
[39]RTP Payload Format for Transport of MPEG-4 Elementary Streams.RFC3640.2003
[40]RTP Payload Format for Transport of MPEG-4 Audio/Visual Streams.RFC3016.2000
[41]Jori Liesenborgs.JRTPLIB 3.5.2.March 26,2006
[42]林宇,郭凌云.Linux网络编程[M].人民邮电出版社.2000年6月
[43]羌春华.一种基于Internet的MPEG-4视频网络传输体系结构[D].东南大学硕士论文2002
[44]葛镜,张国平,王磊.基于DMIF体系的MPEG-4传输[J].有线电视技术.2006年12
[45]杨勇.MPEG-4基于VOP的视频分割及压缩算法研究[D].东南大学博士学位论文.2002
[46]Fred Halsall.多媒体通信[M].人民邮电出版社.2004年3月
[47]毛德操,胡希明.LINUX内核源代码情景分析[M].浙江大学出版社.2001年9月