基于MPEG-4的嵌入式多媒体传输系统的设计
|
摘要
随着互联网的高速发展,人类跨入了一个崭新的信息时代。以视频、音频和数据相结合的多媒体通信作为这个时代的主题,受到人们越来越多的关注。多媒体传输系统是计算机技术、电子技术和自动化技术相结合的产物,其中多媒体压缩技术是其关键技术之一。现在已经有许多多媒体压缩标准,如MPEG-1、MPEG-2、MPEG-4、H.26X等。MEPG-4是最新推出的压缩标准,它覆盖了从低比特率到广播级视频质量的范围。基于MPEG-4的嵌入式多媒体传输系统将先进的嵌入式技术和MPEG-4压缩编码技术相结合,必将有良好的应用与发展前景,能广泛应用于图像通信、视频监控、网络流媒体、数字电视和IPTV等领域。
本文设计了一个基于MPEG-4的嵌入式多媒体传输系统,在该系统中,对于视频数据的处理我们采用了高清晰度和低码率的MPEG-4格式压缩算法,嵌入式操作系统我们采用免费的源码公开嵌入式Linux。
本文首先介绍了多媒体通信的概念、发展及其应用,给出了系统的总体结构设计,然后对MPEG-4视频压缩编码标准进行了分析,主要描述了MPEG-4的组成、编解码器结构及其原理,并给出了MPEG-4简单视频类编码的实现模型。在嵌入式操作系统方面,给出了选择嵌入式linux的理由,阐述了系统中u-boot的启动及功能,对u-boot的启动做了详细介绍。由于视频处理是整个多媒体系统中的重点,所以对系统的视频处理系统做了详细描述,给出了其中的VIA、ITU Input、ITU Output、MPEG-4 Encoder和MPEG-4 Decoder这几个模块的具体软件设计和接口函数。最后,对本系统作了总结与展望。
With the high-speed development of Intenret, the mankind strides into a brand-new information age. As the theme of this age, the multimedia communication combining with video, audio and data is concerned by more and more people. Multimedia transmission system is produced by the combination of computer technology, electronic technology and automation technology, and the critical technique is the multimedia compression technology. Now there are many international standards about multimedia compressions, e.g.MPEG-1/2/4, H.26X. MPEG-4 is the latest standard by the ISO MPEG. It covers the applications from very low bitrate to broadcast equality video. This multimedia transmission system combines embedded technology and MPEG-4 compression coding technology, must be a good prospects for the application and development. It can be widely used in image communications, video surveillance, Network streaming media, IPTV areas and so on.
In this paper, an embedded multimedia transmission system based on MPEG-4 is designed. In this systerm, the audio and video data are processed according to the MPEG-4 specification which has the high division and low bitrate, and the embedded Linux is selected as our embedded OS.
Firstly, this paper has introduced the concept, development trend and application of multimedia communication. Then, MPEG-4 video compression coding standard has been analysed, in which composition, codecs structure and codecs principle have been mostly described. And the implementation model of MPEG-4 simple video coding has been given. In the embedded operating system, it has given the reasons of choosing linux. Then it expounded the start-up and function of the u-boot in this system. The video processing is the focus of the multimedia system, so the video processing of this system has been done a detailed description. It put forward the software design and API of the VIA、ITU Input、ITU Output、MPEG-4 Encoder and MPEG-4 Decoder module. Finally, the main research conclusions summarized, the prospect of further research work is also made.
本文设计了一个基于MPEG-4的嵌入式多媒体传输系统,在该系统中,对于视频数据的处理我们采用了高清晰度和低码率的MPEG-4格式压缩算法,嵌入式操作系统我们采用免费的源码公开嵌入式Linux。
本文首先介绍了多媒体通信的概念、发展及其应用,给出了系统的总体结构设计,然后对MPEG-4视频压缩编码标准进行了分析,主要描述了MPEG-4的组成、编解码器结构及其原理,并给出了MPEG-4简单视频类编码的实现模型。在嵌入式操作系统方面,给出了选择嵌入式linux的理由,阐述了系统中u-boot的启动及功能,对u-boot的启动做了详细介绍。由于视频处理是整个多媒体系统中的重点,所以对系统的视频处理系统做了详细描述,给出了其中的VIA、ITU Input、ITU Output、MPEG-4 Encoder和MPEG-4 Decoder这几个模块的具体软件设计和接口函数。最后,对本系统作了总结与展望。
With the high-speed development of Intenret, the mankind strides into a brand-new information age. As the theme of this age, the multimedia communication combining with video, audio and data is concerned by more and more people. Multimedia transmission system is produced by the combination of computer technology, electronic technology and automation technology, and the critical technique is the multimedia compression technology. Now there are many international standards about multimedia compressions, e.g.MPEG-1/2/4, H.26X. MPEG-4 is the latest standard by the ISO MPEG. It covers the applications from very low bitrate to broadcast equality video. This multimedia transmission system combines embedded technology and MPEG-4 compression coding technology, must be a good prospects for the application and development. It can be widely used in image communications, video surveillance, Network streaming media, IPTV areas and so on.
In this paper, an embedded multimedia transmission system based on MPEG-4 is designed. In this systerm, the audio and video data are processed according to the MPEG-4 specification which has the high division and low bitrate, and the embedded Linux is selected as our embedded OS.
Firstly, this paper has introduced the concept, development trend and application of multimedia communication. Then, MPEG-4 video compression coding standard has been analysed, in which composition, codecs structure and codecs principle have been mostly described. And the implementation model of MPEG-4 simple video coding has been given. In the embedded operating system, it has given the reasons of choosing linux. Then it expounded the start-up and function of the u-boot in this system. The video processing is the focus of the multimedia system, so the video processing of this system has been done a detailed description. It put forward the software design and API of the VIA、ITU Input、ITU Output、MPEG-4 Encoder and MPEG-4 Decoder module. Finally, the main research conclusions summarized, the prospect of further research work is also made.
引文
铩颷1]何忠龙,陈萱华,曹迎槐等.多媒体通信技术[M].北京:中国林业出版社,北京希望电子出版社,2006.
[2]侯正信,杨喜,王文全等译.视频处理与通信[M].北京:电子工业出版社,2003.
[3]Fabio Cavalli,Rita Cucchiara,Massimo Piccardi,Andrea Prati.Performance Analysis ofMPEG-4 Decoder and Encoder[J].IEEE Region 8 Intenrational Symposium onVideo/Image Processing and Multimedia Communications,June 2002:227-231.
[4]吴萍,傅彦,MPEG4编码和流式数据传输[J],实验科学与技术,2003年第3期:79-82.
[5]赵巍,艾斯卡尔,MPEG4视频压缩编码技术及应用[J],信息技术,2005年第9期:47-48.
[6]ISO/IEC JTC1/SC29/WGll N4668,Overview of the MPEG-4 Standard[S].http://www.chiariglione.org/mpeg/standards/mpeg-4/mpeg-4.htm,March 2002.
[7]Iain E.G.Richardson.H.264 and MPEG-4 Video Compression[M].John Wiley & Sons Ltd,2003.
[8]欧阳合,韩军译.H.264和MPEG-4视频压缩[M].长沙:国防科技大学出版社,2004.
[9]田泽,于敦山,盛世敏译.ARM SoC体系结构[M].北京:北京航空航天出版社,2002.
[10]陈章龙,涂时亮.嵌入式系统-Intel StrongARM结构与开发[M].北京:北京航空航天出版社,2002
[11]陈赜.ARM9嵌入式技术及Linux高级实践教程[M].北京:北京航空航天大学出版社,2005.
[12]叶宁.MPEG-4标准在IPTV中的应用[J].中国有线电视,2006年第16期:1593-1596
[13]ISO/IEC JTCI/SC29/WGll N2502,Genetic Coding of Audio-Visual objects,Final DraftInternational Standard[S],Nov.1998.
[14]ISO/IEC JTC1/SC29/WGll N3056,Coding of Moving Pictures and Audio,Maui[S],December 1999.
[15]Yao Wang,Join Ostermann,Ya-Qin Zhang.Video Processing and Cornmunicatians[M].北京:电子工业出版社,2003.
[16]钟玉琢,王琪,贺玉文.基于对象的多媒体数据压缩编码国际标准MPEG-4及其校验模型[M].北京:科学出版社,2000.
铩颷17]吴四清,张国平,葛镜.MPEG-4视频编码核心思想与关键技术[J].科技资讯,2006年第7期:76-77.
[18]A.M.Tourapis,O.C.Au,M.L.Liou.Status Report of Core Experiment on FastBlock-Matching Motion Estimation using Half Stop Zonal Search with Adaptive SearchArea[S].In ISO/IEC JTCI/SC29/WGIIMPEG99/m4580,Seoul,Korea,March 1999.
[19]A.M.Tourapis,O.C.Au,M.L.Liou,G.Shen.Status Report of Core Experiment on FastBlock-Matching Motion Estimation using Diamond Zonal Search with Embedded Radar[S].In ISO/IEC JTC1/SC29/WG11 MPEG99/m4917,Vancouver Canada,July 1999.
[20]T.Koga,K.Iinuma,A.H irano,Y.Iijima,T.Ishiguro.Motion compensated interframe codingfor video conferencing[A].Proc.Nat.Telecommun.Conf.[C].New Orleans:LA,Dec.1981:G531-G535,
[21]R.Li,B.Zeng,M.L.Liou.A new three-step search algorithm for block motion estimation[J].IEEE Trans.on Circuits and Systems for Video Technology,vol.4,no.4,Augst 1994:438-442,
[22]S.Zhu and K.K.Ma,A new diamond search algorithm for fast block matching motionestimation[A].Proc.of Int.Conf.Information[C],Communications and SignalProcessing,vol.1,1997:292-296.
[23]J.Y.Tham,S.Ranganath,M.Ranganath,and A.A.K assim,A Novel UnrestrictedCenter-Biased Diamond Search Algorithm for Block Motion Estimation[J],IEEE Trans.On Circuits & Systems for Video Technology,vol.8,Aug.1998:369-377.
[24]A.M.Tourapis,O.C.Au,M.L.Liou,G.B.Shen,and I.Ahmad,Optimizing the MPEG-4Encoder-Advanced Diamond Zonal Search[A].The 2000 IEEE Intenraional Symposiumon Volume 3,28-31[C],Circuits and Systems,2000.Proceedings,ISCAS 2000 Geneva.May 2000:674-677.
[25]Stefan Beyer,Ken Mayes,Brian Warboys.Application-compliant networking on embeddedsystems[A].Proc.5~(th)Int.Workshop Networked Appliances[C].Liverpool,UK,Oct.2002:53-58.
[26]胡欣杰.嵌入式系统应用研究[J].微计算机信息,1999年第6期:4-5.
[27]朱玮玮,卢虹,杨建明.嵌入式Linux技术研究[J].工业控制计算机,2003年第4期:28-31.
铩颷28]探矽工作室.嵌入式系统开发圣经[M].北京:中国铁道出版杜,2003.
[29]邹思轶.嵌入式Linux设计与应用[M].北京:清华大学出版社,2002.
[30]艾书华,徐立鸿,徐盛林.MPEG-4在嵌入式视频监控系统中的实现[J].计算机测量与控制,2006年第14期:67-69,102.
[31]嵌入式技术探讨[DB/OL].http://blog.csdn.net/eweblue/archive/2005/04/18/352148.aspx.
[32]Yaghmour.K著,韩存兵,龚波译.构建嵌入式Linux系统[M].北京:中国电力出版社,2004.
[33]许信顺,贾智平.嵌入式Linux应用编程[M].北京:机械工业出版社,2007年1月.
[2]侯正信,杨喜,王文全等译.视频处理与通信[M].北京:电子工业出版社,2003.
[3]Fabio Cavalli,Rita Cucchiara,Massimo Piccardi,Andrea Prati.Performance Analysis ofMPEG-4 Decoder and Encoder[J].IEEE Region 8 Intenrational Symposium onVideo/Image Processing and Multimedia Communications,June 2002:227-231.
[4]吴萍,傅彦,MPEG4编码和流式数据传输[J],实验科学与技术,2003年第3期:79-82.
[5]赵巍,艾斯卡尔,MPEG4视频压缩编码技术及应用[J],信息技术,2005年第9期:47-48.
[6]ISO/IEC JTC1/SC29/WGll N4668,Overview of the MPEG-4 Standard[S].http://www.chiariglione.org/mpeg/standards/mpeg-4/mpeg-4.htm,March 2002.
[7]Iain E.G.Richardson.H.264 and MPEG-4 Video Compression[M].John Wiley & Sons Ltd,2003.
[8]欧阳合,韩军译.H.264和MPEG-4视频压缩[M].长沙:国防科技大学出版社,2004.
[9]田泽,于敦山,盛世敏译.ARM SoC体系结构[M].北京:北京航空航天出版社,2002.
[10]陈章龙,涂时亮.嵌入式系统-Intel StrongARM结构与开发[M].北京:北京航空航天出版社,2002
[11]陈赜.ARM9嵌入式技术及Linux高级实践教程[M].北京:北京航空航天大学出版社,2005.
[12]叶宁.MPEG-4标准在IPTV中的应用[J].中国有线电视,2006年第16期:1593-1596
[13]ISO/IEC JTCI/SC29/WGll N2502,Genetic Coding of Audio-Visual objects,Final DraftInternational Standard[S],Nov.1998.
[14]ISO/IEC JTC1/SC29/WGll N3056,Coding of Moving Pictures and Audio,Maui[S],December 1999.
[15]Yao Wang,Join Ostermann,Ya-Qin Zhang.Video Processing and Cornmunicatians[M].北京:电子工业出版社,2003.
[16]钟玉琢,王琪,贺玉文.基于对象的多媒体数据压缩编码国际标准MPEG-4及其校验模型[M].北京:科学出版社,2000.
铩颷17]吴四清,张国平,葛镜.MPEG-4视频编码核心思想与关键技术[J].科技资讯,2006年第7期:76-77.
[18]A.M.Tourapis,O.C.Au,M.L.Liou.Status Report of Core Experiment on FastBlock-Matching Motion Estimation using Half Stop Zonal Search with Adaptive SearchArea[S].In ISO/IEC JTCI/SC29/WGIIMPEG99/m4580,Seoul,Korea,March 1999.
[19]A.M.Tourapis,O.C.Au,M.L.Liou,G.Shen.Status Report of Core Experiment on FastBlock-Matching Motion Estimation using Diamond Zonal Search with Embedded Radar[S].In ISO/IEC JTC1/SC29/WG11 MPEG99/m4917,Vancouver Canada,July 1999.
[20]T.Koga,K.Iinuma,A.H irano,Y.Iijima,T.Ishiguro.Motion compensated interframe codingfor video conferencing[A].Proc.Nat.Telecommun.Conf.[C].New Orleans:LA,Dec.1981:G531-G535,
[21]R.Li,B.Zeng,M.L.Liou.A new three-step search algorithm for block motion estimation[J].IEEE Trans.on Circuits and Systems for Video Technology,vol.4,no.4,Augst 1994:438-442,
[22]S.Zhu and K.K.Ma,A new diamond search algorithm for fast block matching motionestimation[A].Proc.of Int.Conf.Information[C],Communications and SignalProcessing,vol.1,1997:292-296.
[23]J.Y.Tham,S.Ranganath,M.Ranganath,and A.A.K assim,A Novel UnrestrictedCenter-Biased Diamond Search Algorithm for Block Motion Estimation[J],IEEE Trans.On Circuits & Systems for Video Technology,vol.8,Aug.1998:369-377.
[24]A.M.Tourapis,O.C.Au,M.L.Liou,G.B.Shen,and I.Ahmad,Optimizing the MPEG-4Encoder-Advanced Diamond Zonal Search[A].The 2000 IEEE Intenraional Symposiumon Volume 3,28-31[C],Circuits and Systems,2000.Proceedings,ISCAS 2000 Geneva.May 2000:674-677.
[25]Stefan Beyer,Ken Mayes,Brian Warboys.Application-compliant networking on embeddedsystems[A].Proc.5~(th)Int.Workshop Networked Appliances[C].Liverpool,UK,Oct.2002:53-58.
[26]胡欣杰.嵌入式系统应用研究[J].微计算机信息,1999年第6期:4-5.
[27]朱玮玮,卢虹,杨建明.嵌入式Linux技术研究[J].工业控制计算机,2003年第4期:28-31.
铩颷28]探矽工作室.嵌入式系统开发圣经[M].北京:中国铁道出版杜,2003.
[29]邹思轶.嵌入式Linux设计与应用[M].北京:清华大学出版社,2002.
[30]艾书华,徐立鸿,徐盛林.MPEG-4在嵌入式视频监控系统中的实现[J].计算机测量与控制,2006年第14期:67-69,102.
[31]嵌入式技术探讨[DB/OL].http://blog.csdn.net/eweblue/archive/2005/04/18/352148.aspx.
[32]Yaghmour.K著,韩存兵,龚波译.构建嵌入式Linux系统[M].北京:中国电力出版社,2004.
[33]许信顺,贾智平.嵌入式Linux应用编程[M].北京:机械工业出版社,2007年1月.