基于H.264视频压缩编码标准的自适应码率控制算法研究
|
摘要
随着现代化信息技术的迅猛发展,远程视频监控广泛应用于各个领域。传统的监控常常采用有线传输的方法,受到地理环境工作内容等客观条件的限制,并不能灵活机动地根据需要变更监控点。因此,基于无线传输的监控设备被认为是远程监控很好的解决方案。
H.264作为新一代的视频压缩编码标准,采用了多模式的的帧内预测、整数变换与量化、基于上下文自适应的熵编码、多参考帧的预测、高精度亚像素预测、去块滤波器以及抗误码力等技术,使得视频压缩的码率得以大幅降低,非常适合作为基于无线传输的视频压缩编码方案。考虑到监控对于实时性的高要求而无线信道本身存在带宽有限、带宽波动,误码率高等情况,源端采集的原始视频序列若不经过有效的码率控制,根本无法满足无线信道中实时传输的需要。另一方面由于无线信道的不稳定性,监测信道质量反馈参数也被认为是视频编码模式选择的一个重要指标。
为了在恶劣的无线信道环境中能够为达到良好的视频传输质量,本文提出了一种自适应码率控制的方法,通过探测无线信道的反馈的信道参数,判定网络状态及编码端缓冲区满溢程度,利用二次率失真法计算出Lagrangian代价函数,自适应调节编码参数而实现输出码率的控制,利于视频的平滑传输。最后通过实测数据分析优化后的方法对视频主观质量,率失真以及压缩比的影响。
With developing rapidly of modem information technology, video monitor system is adopted to various application. Generally, wire transmission is used to monitoring system, because of geographic environment or working conditions restricted, it is not easy to change monitoring spot. Therefore, it is thought that is a better solution of remote monitoring using wireless video monitor.
The H.264 adopts the intra-prediction technique in the spatial domain to enhance the coding efficiency. Real-time requirement should be very important for monitoring system. Actually, in existence a situation of bandwidth limited, error rate high in the wireless channel, the original video sequence must be compressed to meet the real-time demand. This paper proposes an algorithm which is basing a new standard named H.264. This algorithm can reduce bit rate by using vary effective approach. Because of wireless channel is instability, we can decide the encoding mode according to the feedback parameter from the wireless channel. We fix the encoding mode by referencing network state to predict target parameter.
In order to realize better video quality, it is necessary to change the encoding mode according to the feedback parameter of the varying wireless channel. In this paper, an approach of adaptive rate control to judge the situation of the CDMA network, and the buffer overflow or not, and figure out the cost function. Finally, we analyze the video quality, compression ratio and RD value after optimizing.
H.264作为新一代的视频压缩编码标准,采用了多模式的的帧内预测、整数变换与量化、基于上下文自适应的熵编码、多参考帧的预测、高精度亚像素预测、去块滤波器以及抗误码力等技术,使得视频压缩的码率得以大幅降低,非常适合作为基于无线传输的视频压缩编码方案。考虑到监控对于实时性的高要求而无线信道本身存在带宽有限、带宽波动,误码率高等情况,源端采集的原始视频序列若不经过有效的码率控制,根本无法满足无线信道中实时传输的需要。另一方面由于无线信道的不稳定性,监测信道质量反馈参数也被认为是视频编码模式选择的一个重要指标。
为了在恶劣的无线信道环境中能够为达到良好的视频传输质量,本文提出了一种自适应码率控制的方法,通过探测无线信道的反馈的信道参数,判定网络状态及编码端缓冲区满溢程度,利用二次率失真法计算出Lagrangian代价函数,自适应调节编码参数而实现输出码率的控制,利于视频的平滑传输。最后通过实测数据分析优化后的方法对视频主观质量,率失真以及压缩比的影响。
With developing rapidly of modem information technology, video monitor system is adopted to various application. Generally, wire transmission is used to monitoring system, because of geographic environment or working conditions restricted, it is not easy to change monitoring spot. Therefore, it is thought that is a better solution of remote monitoring using wireless video monitor.
The H.264 adopts the intra-prediction technique in the spatial domain to enhance the coding efficiency. Real-time requirement should be very important for monitoring system. Actually, in existence a situation of bandwidth limited, error rate high in the wireless channel, the original video sequence must be compressed to meet the real-time demand. This paper proposes an algorithm which is basing a new standard named H.264. This algorithm can reduce bit rate by using vary effective approach. Because of wireless channel is instability, we can decide the encoding mode according to the feedback parameter from the wireless channel. We fix the encoding mode by referencing network state to predict target parameter.
In order to realize better video quality, it is necessary to change the encoding mode according to the feedback parameter of the varying wireless channel. In this paper, an approach of adaptive rate control to judge the situation of the CDMA network, and the buffer overflow or not, and figure out the cost function. Finally, we analyze the video quality, compression ratio and RD value after optimizing.
引文
1.(英)lain E.G.Richardson.H.264和MPEG-4视频压缩.国防科技大学出版社.2004
2.毕厚杰.新一代视频压缩编码标准—H.264/AVC.人民邮电出版社.2005
3.(美)Andrew S.Tanenbaum著.计算机网络(第4版).清华大学出版社.2004
4.唐田野,于鸿,刘钊.低码率应用中的一种视频码率控制方法.信号处理,vol.22.No.6Dec.2006:920-923
5.余兆明,查日勇,黄磊,周海骄.图像编码标准H.264技术.人民邮电出版社.2006
6.Chiang T H,Zhang Y Q.A new rate control scheme using quadratic rate distortion model[J].IEEE Transactions on Circuits and Systems for Video Technology,1997,7(1):246-250.
7.Lee H J,Chiang T H,Zhang Y Q.Scalable rate control for MPEG-4 video[J].IEEE Transactions on Circuits and Systems for Video Technology.2000,10(6):878-894.
8.Siwei Ma,Wen Gao,Peng Gao.Rate control for advance video coding(ArC)Standard[A].In:IEEE International Symposium on Circuits and Systems[C],Bangkok,Thailand,2003,2:892-895.
9.Kim Yong Kwan,He Zhihai,Sanjit K M.Low-delay rate control for DCT video coding via p-domain source modeling[J].IEEE Transactions on Circuits and Systems for Video Technology,2001,11(8):928-940.
10.朱光喜,李霄.低码率下码率控制策略的研究.计算机与数字工程.2005年第6期
11.慈轶为,时锐.任哲.一种低码率的动态图像压缩.计算机工程与应用.2004.5
12.Peter Lee.H.264三大开源编码器之测评报告,http://blog.csdn.net/sunshine1314/archive/2006/01/10/397895.aspx,2005.6.19
13.马思伟,高文.一种面向H.264/AVC的码率控制算法.电子学报.2004年12月
14.刘玉珍,王玉洁,杨会玉.甚低码率视频信号压缩编码技术.辽宁工程技术大学学报.2004 年12月
15.朱光喜,戴声奎.一种低码率下的新型码率控制策略.计算机科学.2006 Vol.33.No.1
16.潘敏,林都平.无线环境中H.264/AVC结构的改进.电子科技.2004年第8期
17.魏振宇.H.264编解码器在C6416 DSP上的实现与优化.电子产品世界.2005.5
18.周全,刘文予.一种低码率下的新型宏块级码率控制算法.中国图像图像学报.2006.9
19.Bang H and Chen J.Source model for transform video coder and its application-part Ⅰ:Fundam ental theory.IEEE Trans.on Circuits st.on Video Technology,1997,7(2):287-298.
20.He Z,Kim Y and Mitra S.Low-delay rate control for DCT video coding via P.domain Sollrce modeling.IEEE Trans.on Circuits st.on Video Technology,2001,11(8):928-940.
21.Chiang T and Zhang Y.A new rate control scheme using quadratic rate distortion model.IEEE Trans.on Circuits st.on Video Technology,1997,7(1):246-250.
22.Lee H,Chiang T,and Zhang Y.Scalable rate control for MPEG—4 Video.IEEE Trans.on Circuits Tyst.on Video Technology,2000,10(6):878-894.
23.王丽丰,牛建伟,肖晨,胡建平.基于H.264无线视频传输系统的研究.2005.10.Vol.22
24.万帅,常义林,杨付正.罗忠 一种新的视频编码二次率失真模型及其性能分析.2007.3Vol.29 No.5
25.林潇.基于无线信道传输质量的动态图象多信道自适应选择策略的研究.2007.4.
26.H.264的码率控制策略.中华视频网.http://www.vvou.com/index.php?option=com_content&task=view&id=2&Itemid=5
27.Tanenbaum著.潘爱民译.计算机网络(第4版).清华大学出版社.2004
28.刘宝兰,刘贵忠,苏睿.H.264中整数DCT变换及量化的DSP实现.微电子学与计算机.2005年22卷6期
29.Wilson C.Chung.在FPGA上实现H.264/AVC视频编码标准.通信与计算机.2005.8
30.林叶,彭强.一种H.264帧内模式选择快速算法.成都信息工程学院学报.2007年2月. Vol.22 No.1
31.徐进,吴志美.结合人眼视觉特性的率失真优化帧内刷新算法.通信学报.2007.3,Vol.28No.3
32.COTE G.Optimal intra coding of blocks for robust video communication over the Intemet[J].Signal Processing:ImageCommunication,1999,15(12):25-34.
33.WORRALLS T.Motion adaptive intra refresh for MPEG-4.Electronics letters.2000.36(23):1924-1925.
34.TANG C.Visual sensitivity guided bit allocation for video coding[J].IEEE Transactions on Multimedia.2006,8(1):11-18.
35.HE Z,CAI J,CHE N C.Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding[J],IEEE Transactions on Circuits and Systems for Video Technology.2002.12(6):511-523.
36.CASTLEMAN K R.数字图像处理.电子工业出版社.2002.
37.杨传栋等.端到端的流媒体传输控制技术研究综述.计算机工程与应用.2005.8
38.博学.基于RTP协议的视频传输与网络阻塞控制研究.北京科技大学硕士学位论文.2005
39.Padhye J,Firoiu V,Towsley D et al.Modeling TCP throughput:a simple model and its empirical validation.Proceedings of the SIGCOMM,1998.
40.S Floyd,M Handley,J Padhye et al.Equation-Based Congestion Control for Unicast Applications.Proceedings of SIGCOMM 2000.
41.M Handley,J Padhye,S Floyd et al.TCP Friendly Rate Control(TFRC):Protocol Specification.RFC 3448,2003.
42.马思伟.基于率失真优化的视频编码研究.计算机应用.2005.06
43.牛宁.率失真代价函数在信源信道编码中的应用.计算机科学与技术.2005.6
44.T.Berger.Rate Distortion Theory.Prentice Hall,Engle wood Cliffs.New Jersey,1971
45.李虓江.,陈抗生.一种H.264视频流自适应率失真优化编码算法.电路与系统学报.2005年10卷6期
46.张建宁H.264快速帧内预测算法.第十二届全国多媒体技术学术会议.2003.9
47.Douglas E.Comer,赵刚等译.用TCP/IP进行网际互联第3卷.电子工业出版社.2005
48.W Richard Stevens著,范建华等译.TCP/IP详解 卷1.机械工业出版社.2000
49.Gary R.Wright,W Richard Stevens著,陆雪莹等译.TCP/IP详解卷2.机械工业出版社.2000
50.罗万明等.TCP/IP拥塞控制研究.计算机学报.2001.1
2.毕厚杰.新一代视频压缩编码标准—H.264/AVC.人民邮电出版社.2005
3.(美)Andrew S.Tanenbaum著.计算机网络(第4版).清华大学出版社.2004
4.唐田野,于鸿,刘钊.低码率应用中的一种视频码率控制方法.信号处理,vol.22.No.6Dec.2006:920-923
5.余兆明,查日勇,黄磊,周海骄.图像编码标准H.264技术.人民邮电出版社.2006
6.Chiang T H,Zhang Y Q.A new rate control scheme using quadratic rate distortion model[J].IEEE Transactions on Circuits and Systems for Video Technology,1997,7(1):246-250.
7.Lee H J,Chiang T H,Zhang Y Q.Scalable rate control for MPEG-4 video[J].IEEE Transactions on Circuits and Systems for Video Technology.2000,10(6):878-894.
8.Siwei Ma,Wen Gao,Peng Gao.Rate control for advance video coding(ArC)Standard[A].In:IEEE International Symposium on Circuits and Systems[C],Bangkok,Thailand,2003,2:892-895.
9.Kim Yong Kwan,He Zhihai,Sanjit K M.Low-delay rate control for DCT video coding via p-domain source modeling[J].IEEE Transactions on Circuits and Systems for Video Technology,2001,11(8):928-940.
10.朱光喜,李霄.低码率下码率控制策略的研究.计算机与数字工程.2005年第6期
11.慈轶为,时锐.任哲.一种低码率的动态图像压缩.计算机工程与应用.2004.5
12.Peter Lee.H.264三大开源编码器之测评报告,http://blog.csdn.net/sunshine1314/archive/2006/01/10/397895.aspx,2005.6.19
13.马思伟,高文.一种面向H.264/AVC的码率控制算法.电子学报.2004年12月
14.刘玉珍,王玉洁,杨会玉.甚低码率视频信号压缩编码技术.辽宁工程技术大学学报.2004 年12月
15.朱光喜,戴声奎.一种低码率下的新型码率控制策略.计算机科学.2006 Vol.33.No.1
16.潘敏,林都平.无线环境中H.264/AVC结构的改进.电子科技.2004年第8期
17.魏振宇.H.264编解码器在C6416 DSP上的实现与优化.电子产品世界.2005.5
18.周全,刘文予.一种低码率下的新型宏块级码率控制算法.中国图像图像学报.2006.9
19.Bang H and Chen J.Source model for transform video coder and its application-part Ⅰ:Fundam ental theory.IEEE Trans.on Circuits st.on Video Technology,1997,7(2):287-298.
20.He Z,Kim Y and Mitra S.Low-delay rate control for DCT video coding via P.domain Sollrce modeling.IEEE Trans.on Circuits st.on Video Technology,2001,11(8):928-940.
21.Chiang T and Zhang Y.A new rate control scheme using quadratic rate distortion model.IEEE Trans.on Circuits st.on Video Technology,1997,7(1):246-250.
22.Lee H,Chiang T,and Zhang Y.Scalable rate control for MPEG—4 Video.IEEE Trans.on Circuits Tyst.on Video Technology,2000,10(6):878-894.
23.王丽丰,牛建伟,肖晨,胡建平.基于H.264无线视频传输系统的研究.2005.10.Vol.22
24.万帅,常义林,杨付正.罗忠 一种新的视频编码二次率失真模型及其性能分析.2007.3Vol.29 No.5
25.林潇.基于无线信道传输质量的动态图象多信道自适应选择策略的研究.2007.4.
26.H.264的码率控制策略.中华视频网.http://www.vvou.com/index.php?option=com_content&task=view&id=2&Itemid=5
27.Tanenbaum著.潘爱民译.计算机网络(第4版).清华大学出版社.2004
28.刘宝兰,刘贵忠,苏睿.H.264中整数DCT变换及量化的DSP实现.微电子学与计算机.2005年22卷6期
29.Wilson C.Chung.在FPGA上实现H.264/AVC视频编码标准.通信与计算机.2005.8
30.林叶,彭强.一种H.264帧内模式选择快速算法.成都信息工程学院学报.2007年2月. Vol.22 No.1
31.徐进,吴志美.结合人眼视觉特性的率失真优化帧内刷新算法.通信学报.2007.3,Vol.28No.3
32.COTE G.Optimal intra coding of blocks for robust video communication over the Intemet[J].Signal Processing:ImageCommunication,1999,15(12):25-34.
33.WORRALLS T.Motion adaptive intra refresh for MPEG-4.Electronics letters.2000.36(23):1924-1925.
34.TANG C.Visual sensitivity guided bit allocation for video coding[J].IEEE Transactions on Multimedia.2006,8(1):11-18.
35.HE Z,CAI J,CHE N C.Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding[J],IEEE Transactions on Circuits and Systems for Video Technology.2002.12(6):511-523.
36.CASTLEMAN K R.数字图像处理.电子工业出版社.2002.
37.杨传栋等.端到端的流媒体传输控制技术研究综述.计算机工程与应用.2005.8
38.博学.基于RTP协议的视频传输与网络阻塞控制研究.北京科技大学硕士学位论文.2005
39.Padhye J,Firoiu V,Towsley D et al.Modeling TCP throughput:a simple model and its empirical validation.Proceedings of the SIGCOMM,1998.
40.S Floyd,M Handley,J Padhye et al.Equation-Based Congestion Control for Unicast Applications.Proceedings of SIGCOMM 2000.
41.M Handley,J Padhye,S Floyd et al.TCP Friendly Rate Control(TFRC):Protocol Specification.RFC 3448,2003.
42.马思伟.基于率失真优化的视频编码研究.计算机应用.2005.06
43.牛宁.率失真代价函数在信源信道编码中的应用.计算机科学与技术.2005.6
44.T.Berger.Rate Distortion Theory.Prentice Hall,Engle wood Cliffs.New Jersey,1971
45.李虓江.,陈抗生.一种H.264视频流自适应率失真优化编码算法.电路与系统学报.2005年10卷6期
46.张建宁H.264快速帧内预测算法.第十二届全国多媒体技术学术会议.2003.9
47.Douglas E.Comer,赵刚等译.用TCP/IP进行网际互联第3卷.电子工业出版社.2005
48.W Richard Stevens著,范建华等译.TCP/IP详解 卷1.机械工业出版社.2000
49.Gary R.Wright,W Richard Stevens著,陆雪莹等译.TCP/IP详解卷2.机械工业出版社.2000
50.罗万明等.TCP/IP拥塞控制研究.计算机学报.2001.1