H.264在城市轨道交通视频监控中码率控制的研究
|
摘要
城市轨道交通视频监控是城市公共安全领域的重要保障手段,也是视频监控领域的一个研究热点。随着软硬件技术的不断进步,视频采样技术、视频压缩编码技术和视频传输技术的发展,城市轨道交通视频监控技术也得到了长足进步。H.264是国际标准化组织(ISO)和国际电信联盟(ITU)共同制定的新一代视频编码标准,它采用了一系列的新技术,显著的提高了编码效率,成为近年来最为高效的视频压缩编码标准。为了在有限的网络带宽、延时和缓存下取得较好的图像质量,必须采用适当的策略来控制编码器,将编码器的码率输出控制在一定的范围内,码率控制技术随之成为视频编码的关键技术之一,也是实现城市轨道交通视频监控高质量和高实时性要求的解决方法。
本文在探讨了城市轨道交通视频监控的发展现状后对于其所涉及到的关键技术进行了研究,重点介绍了视频压缩编码技术中的H.264编码标准,深入分析了码率控制的基本原理,讨论了视频编码中产生码率波动的原因,介绍并总结了当前主流编码标准的码率控制算法,其中对H.264的码率控制算法进行了详细分析,对GOP层、帧层和基本单元层三个层次的码率控制进行分析,完全剖析了H.264码率控制算法的原理和步骤。
在现有的H.264码率控制技术研究成果的基础上,结合城市轨道交通视频监控的实际需求,本文提出了一种基于线性回归的H.264码率控制算法。该算法利用线性回归的思想建立了QP－PSNR的线性模型和R－ρ－Eρ－EQP－QP线性模型,可以为视频序列中的工帧和P帧快速的计算出更为精确的量化参数QP,大大简化了计算的复杂度,克服了现有H.264码率控制算法在运算效率上的不足,实现更为有效的码率控制。实验结果表明,与现有的两种H.264码率控制算法相比,基于线性回归的算法在码率错误估计、视频质量和缓冲区占有率等方面都凸现出优势,满足轨道交通视频监控中的高质量和高实时性的要求。
在以上的理论基础上,论文提出了城市轨道交通视频监控的总体设计方案,为轨道交通视频监控的实现给出了系统设计和设备分配的参考方案。结合方案设备选型实现了一个基于线性回归码率控制算法的视频监控系统,为城市轨道交通视频监控系统的研究实现做了有目的的尝试,以此证明方案的可行性和基于线性回归码率控制算法的有效性。
Video Surveillance for urban rail transportation is an important way for the Urban public security areas, is also a hotpot of research in the Video Surveillance area. With the continuous improvement of the hardware and software , the development of Video sampling technology, video compression and coding technology and video transmission technology, Video Surveillance for Urban rail transportation technology has also developed rapidly. As a new generation video coding standard developed jointly by ISO and ITU. H.264 employs a series of new technologies, improves video coding efficiency greatly, and has been nominated to be the most efficient video coding standard in recent years as a result. To achieve better image quality under the channel bandwidth, time-lapse and buffer limitation, appropriate strategies must be adopted to control the rate of encoder's output into a certain range.Therefore, rate control has become one of the key techniques of video coding, also is the Solution to achieve high quality video and high real-time requirement of Video Surveillance for Urban rail transportation.
After discuession about the development status of video surveillance for urban rail transportation, the Related key technologies are analyzed, the video coding standard of H.264 is introduced, the basic principle of rate control is discuessed deeply, the reasons that cause the rate variance are analyzed, and the algorithms of several video coding standards are also reviewed ans summarized in this dissertation. Based on the existing research results of the rate control technique for H.264, considered about the actual requirement of videosurveillance for urban rail transportation, a rate control algorithm based on the linear regression for H.264 is proposed. With the theory of linear regression, the algorithm establishes two linear models of QP-PSNR and R-ρ-E_ρ-E_(QP)-QP in order to calculate more precise quantitative parameters, overcomes the limitation of existing algorithms in calculation efficiency, and achieves more effective rate control. The experimental results show that, the algorithm based on the linear outperforms the existing rate control algorithms for H.264 for rate estimation error ,video quality and buffer occupancy.With the theory discuessed above , an overall design of video surveillance for urban rail transportation is proposed, and a video surveillance system based on the linear regression is eastablished for a try, in order to prove the feasibility of the design and the availability of the rate control algorithm based on linear regression.
本文在探讨了城市轨道交通视频监控的发展现状后对于其所涉及到的关键技术进行了研究,重点介绍了视频压缩编码技术中的H.264编码标准,深入分析了码率控制的基本原理,讨论了视频编码中产生码率波动的原因,介绍并总结了当前主流编码标准的码率控制算法,其中对H.264的码率控制算法进行了详细分析,对GOP层、帧层和基本单元层三个层次的码率控制进行分析,完全剖析了H.264码率控制算法的原理和步骤。
在现有的H.264码率控制技术研究成果的基础上,结合城市轨道交通视频监控的实际需求,本文提出了一种基于线性回归的H.264码率控制算法。该算法利用线性回归的思想建立了QP－PSNR的线性模型和R－ρ－Eρ－EQP－QP线性模型,可以为视频序列中的工帧和P帧快速的计算出更为精确的量化参数QP,大大简化了计算的复杂度,克服了现有H.264码率控制算法在运算效率上的不足,实现更为有效的码率控制。实验结果表明,与现有的两种H.264码率控制算法相比,基于线性回归的算法在码率错误估计、视频质量和缓冲区占有率等方面都凸现出优势,满足轨道交通视频监控中的高质量和高实时性的要求。
在以上的理论基础上,论文提出了城市轨道交通视频监控的总体设计方案,为轨道交通视频监控的实现给出了系统设计和设备分配的参考方案。结合方案设备选型实现了一个基于线性回归码率控制算法的视频监控系统,为城市轨道交通视频监控系统的研究实现做了有目的的尝试,以此证明方案的可行性和基于线性回归码率控制算法的有效性。
Video Surveillance for urban rail transportation is an important way for the Urban public security areas, is also a hotpot of research in the Video Surveillance area. With the continuous improvement of the hardware and software , the development of Video sampling technology, video compression and coding technology and video transmission technology, Video Surveillance for Urban rail transportation technology has also developed rapidly. As a new generation video coding standard developed jointly by ISO and ITU. H.264 employs a series of new technologies, improves video coding efficiency greatly, and has been nominated to be the most efficient video coding standard in recent years as a result. To achieve better image quality under the channel bandwidth, time-lapse and buffer limitation, appropriate strategies must be adopted to control the rate of encoder's output into a certain range.Therefore, rate control has become one of the key techniques of video coding, also is the Solution to achieve high quality video and high real-time requirement of Video Surveillance for Urban rail transportation.
After discuession about the development status of video surveillance for urban rail transportation, the Related key technologies are analyzed, the video coding standard of H.264 is introduced, the basic principle of rate control is discuessed deeply, the reasons that cause the rate variance are analyzed, and the algorithms of several video coding standards are also reviewed ans summarized in this dissertation. Based on the existing research results of the rate control technique for H.264, considered about the actual requirement of videosurveillance for urban rail transportation, a rate control algorithm based on the linear regression for H.264 is proposed. With the theory of linear regression, the algorithm establishes two linear models of QP-PSNR and R-ρ-E_ρ-E_(QP)-QP in order to calculate more precise quantitative parameters, overcomes the limitation of existing algorithms in calculation efficiency, and achieves more effective rate control. The experimental results show that, the algorithm based on the linear outperforms the existing rate control algorithms for H.264 for rate estimation error ,video quality and buffer occupancy.With the theory discuessed above , an overall design of video surveillance for urban rail transportation is proposed, and a video surveillance system based on the linear regression is eastablished for a try, in order to prove the feasibility of the design and the availability of the rate control algorithm based on linear regression.
引文
[1]GB5655-8,城市公共交通常用名词术语[S]
[2]K.P.Lim,G.Sullivan,T.Wiegand,Text description of joint model reference encoding methods and decoding concealment methods,in:Joint Video Team of ISO/IEC JTC1/SC29/WG11 & ITU-T SG16/Q.6 Doc.JVT-N046,Hong Kong,China,January 2005
[3]ITU-TR ec.H.264.Advanced video coding.Oct.2002
[4]ISO/IEC JTC1/SC29/WGI1/Doc.N3093.MPEG-4 video verification model version 15.0.Dec.1999
[5]ISO/IEC13818-2.Information technology and associated audio Part2:Video,1995
[6]Weisberg,S.Applied Linear Regression,2nd Edition,Wiley,New York,NY,1985
[7]J.D.Gibson,T.Berger,T.Looabaughetal.Digital compression for multimedia principles & atandards.San Fransisco,Morgan Kaufmann Publishers Inc,1997
[8]王田苗,嵌入式系统设计与实例开发[M].北京:清华大学出版社,2003(10)
[9]罗蕾,嵌入式实时操作系统的及其应用开发[M].北京:北京航空航天大学出版社
[10]杜春雷.ARM体系结构与编程[M].北京:清华大学出版社.
[11]VxWorks Programmer's Guide 5.4[Z].USA:WindRrver Systems Inc,1999
[12]pSOSystem System Concepts.Copyright/1999.Integrated Systems Inc.Revision Date:1991(1)
[13]Nucleus Plus Reference Manual[R].Accelerated Technology Inc.,1998
[14]QNX neutrino realtime operating system architecture[Z].Kanata,Ontario:QNX Soft System Ltd.,2002
[15]QNX neutrino realtime operating system programmer's guide[Z].Kanata,Ontario:QNX Soft System Ltd.,2002
[16]Boling D.Programming Microsoft windows CE[M].Edition2.Microsoft Publishers,1999
[17]Reworks开发指南[M].华东计算技术研究所
[18]成立,王振宇,景亮.SOC设计:IC产业链设计史上的重大革命[J].半导体技术,2004,29(12):8-12
[19]中国科学院声学研究所.DSP开发与应用[R].北京:北京高科数据信号处理公司,1999:82-96
[20]褚振勇,翁木云.FPGA设计与应用[M].西安:西安电子科技大学出版社,2002
[21]蔡俊.无线局域网技术标准及其比较[J].中国数据通信,2002(7):27-29
[22]刘富强,数字视频监控系统开发及应用[M].北京:机械工业出版社,2003
[23]黄贤武,王加俊,李家华.数字图像处理与压缩编码技术.成都:电子科技大学出版社
[24]张晓清,潘清.操作系统微内核技术研究[J].软件学报1998:(9)
[25]曹晨,杨作梅.数字电视技术,高清晰度数字视频原理与应用(第三版).成都:电子工业出版社
[26]Litwiller D.CCD vs.CMOS:facts and fiction.Photonics Spectra,2001,(1)
[27]ISO/IEC CD 11172.Coding of moving pictures and associated audio for digital storage media at up to 1.5Mbits/sec Part2:Coding of moving pictures information.Dec.1991
[28]ITU-T Recommendation H.261.Video codec for audio visual services at px64kbit/s in Proc.COM 15R 16-E.March 1993
[29]朱秀昌,刘峰.会议电视系统及应用技术[M].北京:人民邮电出版社,1999
[30]ITU-T Recommendation H.263.Video coding for low bit rate communication.May 1996
[31]胡国荣.数字视频压缩及其标准[M].北京:北京广播学院出版社,1999
[32]W A.Arbaugh and N.Shankar.Your 802.11 Wireless Network has no clothes[EB/OL].http://www.es.umd.edu/w aa/wirelsss.pdf.2001
[33]Joseph J.Carr.Microwave and Wireless Communications Technology[M].Publisher:Butterworth-Heinemann,1996
[34]IE EE802.11 Standard[S],1997
[35]IEEE802.11a/b Standard[S],1999
[36]王顺满.无线局域网技术与安全[M].北京:机械工业出版社,2005
[37]钱进.无线局域网技术与应用[M].北京:电子工业出版社,2004
[38]翟海涌.数字视频网络传输层协议的选择[Z].2002,(2),61-64
[39]James F.Kurose,Keith W.Ross.Computer Networking:A Top-Down Approach Featuring the Inernet.Pearson Education/Higher Eduction Press
[40]许华荣,李名世.基于RTP的实时视频传输系统[J].计算机工程与设计,2005,26(4):876-878
[41]M Wagner,D Saupe.Video Coding With Adaptive Vector Quantization and Rate-Distortion Optimization.[EB/OL]www.inf.uni-konstanz.de/cgip/bib/files
[42]Z.He,Y.K.Kim,S.K.Mitra,Low-delay rate controlfor DCT video coding via p-domain source modeling,IEEE Trans.Circuits Syst.Video Technol.11(8)(2001)928-940
[43]Kannangara,C.S.,et al.Low-Complexity Skip Prediction for H.264 Through Lagrangian Cost Estimation.Circuits and Systems for Video Technology,IEEE Transactions on,2006,16(2):202
[44]Kondi L P,Katsaggelos A K.An operational rate-distortion optimal single-pass SNR scalable video coder[J].IEEE Trans Image Processing,2001,10(11):1613-1620
[45]Sung-Chang Lim,Hyeong-Ryul Na,Yung-Lyul Lee.Rate control based on linear regression for H.264/MPEG-4 AVC.Signal Processing:Image Communication 22(2007)39-58
[46]T.Wiegand,Draft ITU-T Recommendation H.264 and Draft ISO/IEC 14496-10 AVC,in:Joint Video Team of ISO/IEC JTC1/SC29/WG11 & ITU-T SG16/Q.6 Doc.JVTG050,Pattaya,Thailand,March 2003
[47]H.264/AVC Reference Software Version 9.3,http://iphome.hhi.de/suehring/tml-/download/
[48]S.Milani,L.Celetto,G.A.Mian,A rate control algorithm for the H.264 encoder,in:Proceedings of the Sixth Baiona Workshop on Signal Processing in Communications,Baiona,Spain,September 2003,pp.390-396
[2]K.P.Lim,G.Sullivan,T.Wiegand,Text description of joint model reference encoding methods and decoding concealment methods,in:Joint Video Team of ISO/IEC JTC1/SC29/WG11 & ITU-T SG16/Q.6 Doc.JVT-N046,Hong Kong,China,January 2005
[3]ITU-TR ec.H.264.Advanced video coding.Oct.2002
[4]ISO/IEC JTC1/SC29/WGI1/Doc.N3093.MPEG-4 video verification model version 15.0.Dec.1999
[5]ISO/IEC13818-2.Information technology and associated audio Part2:Video,1995
[6]Weisberg,S.Applied Linear Regression,2nd Edition,Wiley,New York,NY,1985
[7]J.D.Gibson,T.Berger,T.Looabaughetal.Digital compression for multimedia principles & atandards.San Fransisco,Morgan Kaufmann Publishers Inc,1997
[8]王田苗,嵌入式系统设计与实例开发[M].北京:清华大学出版社,2003(10)
[9]罗蕾,嵌入式实时操作系统的及其应用开发[M].北京:北京航空航天大学出版社
[10]杜春雷.ARM体系结构与编程[M].北京:清华大学出版社.
[11]VxWorks Programmer's Guide 5.4[Z].USA:WindRrver Systems Inc,1999
[12]pSOSystem System Concepts.Copyright/1999.Integrated Systems Inc.Revision Date:1991(1)
[13]Nucleus Plus Reference Manual[R].Accelerated Technology Inc.,1998
[14]QNX neutrino realtime operating system architecture[Z].Kanata,Ontario:QNX Soft System Ltd.,2002
[15]QNX neutrino realtime operating system programmer's guide[Z].Kanata,Ontario:QNX Soft System Ltd.,2002
[16]Boling D.Programming Microsoft windows CE[M].Edition2.Microsoft Publishers,1999
[17]Reworks开发指南[M].华东计算技术研究所
[18]成立,王振宇,景亮.SOC设计:IC产业链设计史上的重大革命[J].半导体技术,2004,29(12):8-12
[19]中国科学院声学研究所.DSP开发与应用[R].北京:北京高科数据信号处理公司,1999:82-96
[20]褚振勇,翁木云.FPGA设计与应用[M].西安:西安电子科技大学出版社,2002
[21]蔡俊.无线局域网技术标准及其比较[J].中国数据通信,2002(7):27-29
[22]刘富强,数字视频监控系统开发及应用[M].北京:机械工业出版社,2003
[23]黄贤武,王加俊,李家华.数字图像处理与压缩编码技术.成都:电子科技大学出版社
[24]张晓清,潘清.操作系统微内核技术研究[J].软件学报1998:(9)
[25]曹晨,杨作梅.数字电视技术,高清晰度数字视频原理与应用(第三版).成都:电子工业出版社
[26]Litwiller D.CCD vs.CMOS:facts and fiction.Photonics Spectra,2001,(1)
[27]ISO/IEC CD 11172.Coding of moving pictures and associated audio for digital storage media at up to 1.5Mbits/sec Part2:Coding of moving pictures information.Dec.1991
[28]ITU-T Recommendation H.261.Video codec for audio visual services at px64kbit/s in Proc.COM 15R 16-E.March 1993
[29]朱秀昌,刘峰.会议电视系统及应用技术[M].北京:人民邮电出版社,1999
[30]ITU-T Recommendation H.263.Video coding for low bit rate communication.May 1996
[31]胡国荣.数字视频压缩及其标准[M].北京:北京广播学院出版社,1999
[32]W A.Arbaugh and N.Shankar.Your 802.11 Wireless Network has no clothes[EB/OL].http://www.es.umd.edu/w aa/wirelsss.pdf.2001
[33]Joseph J.Carr.Microwave and Wireless Communications Technology[M].Publisher:Butterworth-Heinemann,1996
[34]IE EE802.11 Standard[S],1997
[35]IEEE802.11a/b Standard[S],1999
[36]王顺满.无线局域网技术与安全[M].北京:机械工业出版社,2005
[37]钱进.无线局域网技术与应用[M].北京:电子工业出版社,2004
[38]翟海涌.数字视频网络传输层协议的选择[Z].2002,(2),61-64
[39]James F.Kurose,Keith W.Ross.Computer Networking:A Top-Down Approach Featuring the Inernet.Pearson Education/Higher Eduction Press
[40]许华荣,李名世.基于RTP的实时视频传输系统[J].计算机工程与设计,2005,26(4):876-878
[41]M Wagner,D Saupe.Video Coding With Adaptive Vector Quantization and Rate-Distortion Optimization.[EB/OL]www.inf.uni-konstanz.de/cgip/bib/files
[42]Z.He,Y.K.Kim,S.K.Mitra,Low-delay rate controlfor DCT video coding via p-domain source modeling,IEEE Trans.Circuits Syst.Video Technol.11(8)(2001)928-940
[43]Kannangara,C.S.,et al.Low-Complexity Skip Prediction for H.264 Through Lagrangian Cost Estimation.Circuits and Systems for Video Technology,IEEE Transactions on,2006,16(2):202
[44]Kondi L P,Katsaggelos A K.An operational rate-distortion optimal single-pass SNR scalable video coder[J].IEEE Trans Image Processing,2001,10(11):1613-1620
[45]Sung-Chang Lim,Hyeong-Ryul Na,Yung-Lyul Lee.Rate control based on linear regression for H.264/MPEG-4 AVC.Signal Processing:Image Communication 22(2007)39-58
[46]T.Wiegand,Draft ITU-T Recommendation H.264 and Draft ISO/IEC 14496-10 AVC,in:Joint Video Team of ISO/IEC JTC1/SC29/WG11 & ITU-T SG16/Q.6 Doc.JVTG050,Pattaya,Thailand,March 2003
[47]H.264/AVC Reference Software Version 9.3,http://iphome.hhi.de/suehring/tml-/download/
[48]S.Milani,L.Celetto,G.A.Mian,A rate control algorithm for the H.264 encoder,in:Proceedings of the Sixth Baiona Workshop on Signal Processing in Communications,Baiona,Spain,September 2003,pp.390-396