基于H.263的视频传输关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
通过无线和互联网传输视频是视频通信的发展趋势。然而由于有限的带宽和恶劣的通信环境,使得窄带高噪声成为无线和互联网视频通信的难点。本文研究了基于H.263视频压缩编码标准的视频传输若干关键问题,包括:视频传输的抗误码技术、快速高效的压缩编码技术、视频质量评价方法等,并且实现了一个局域网内视频传输演示实验系统。
     如何消除或减小噪声对视频信息的影响是视频传输中的重要问题。前向纠错的方法可以提高压缩后的视频码流在传输中抵抗误码的能力,但要以降低压缩效率为代价。由于视频信息具有非常强的时间空间相关性,因而可以通过误码掩盖的方法减小误码对视频质量造成的影响。本文针对因特网视频传输中的丢包现象进行研究,一方面利用RS编码来提高视频压缩码流抵抗误码的能力;另一方面,提出了一种基于运动特征的自适应误码掩盖方法,能够较好的掩盖视频传输带来的误码,特别对于运动幅度较大的视频序列更能体现出其优势。
     数据量大是视频信息的突出特点,较小的时延抖动是视频通信最基本的要求,因此高效快速的视频压缩技术成为视频传输的关键。本文以H.263压缩编码标准为基本框架,针对其中影响压缩效率和速度的瓶颈展开研究,包括快速运动搜索算法的研究、预判零方法的研究以及MMX技术在视频编码中的应用等,提出了一种基于时域预测的预判零新方法,在不影响重建视频质量的条件下具有较高的判别效率,节约了大量DCT变换和量化的时间,提高了编码的速度,达到了实时性要求。
     视频质量是衡量视频传输服务质量的重要指标,而对其的评价是一个与人眼视觉特性密切相关的过程。本文提出一种基于运动特征的视频质量评价方法,考虑了人眼对视频信号感受质量与画面运动剧烈程度之间的关系,分别讨论了反映视频质量的视频清晰度和流畅度,评价结果更符合人眼视觉特性,并且这种评价对编码具有一定的指导作用。
     综合以上研究,实现了一个局域网内视频传输演示实验系统,该系统包括采集、压缩编码、传输、解码和显示等环节,从而验证了研究成果的实用性和有效性。
Video transmission over unreliable channels such as wireless channels and Internet has become trend of video communication. However, there are some inherent problems in wireless channels and Internet that affect video delivery, such as limited bandvvidth, varying delay and high levels of noise. Some key issues in video transmission based on H.263, including video compression, error resilient and video quality evaluation are studied in this paper. Finally, a video transmission DEMO in LAN is implemented.
    When a video stream is conveyed through a vvireless channel or Internet to the receiver end, it is exposed to high levels of bit errors or packet loss. These errors severely degrade the service quality of video communication due to the propagation and accumulation of errors throughout the transmitted video stream. There are several procedures used to reduce these deteriorating effects, including the use of Forward Error Correction techniques, error concealment methods and error resilience schemes.This paper studies error resilient techniques in Internet video transmission. In this techeniques, Reed-Solomon(RS) codes across packets is used for error protection against packet loss, and a self-adaptive error concealment method based on motion feature is proposed, which can conceal errors more effectively, particularly for video sequences with acute motion.
    Due to limited bandvvidth and stringent requirements of real-time video plavback, video coding is an indispensable process for many visual communication applications and always requires a very high compression ratio. Generally speaking, a coding algorithm must be low complexity and work at high speed. In this paper, the coding methods are studied to increase coding speed. Firstly, a novel method based on temporal prediction to detect all-zero DCT coefficients is proposed, which can greatly reduce the coding cost and maintain a good tradeoff between correct detecting ratio and false detecting ratio with little additional computation. Secondly, a new diamond search (DS) algorithm for fast block-matching motion estimation is implemented. We also map some of the instructions onto IntePs MMX architecture. Using the above algorithms, H.263 baseline video-encoder implementation can encode more than 40fps in QCIF resolution on a Pentium MMX 500-MHz computer.
    Almost ali of the low bit-rate video compression techniques degrade quality. To combine the video quality evaluation with HVS, the relationship betvveen the motion activity and perceptual video quality are studied, and a video quality evaluation method based on motion activity is proposed, in which video defmition and smoothness are defined.
    Finally, a near real-time software-only DEMO is presented to demonstrate the overall procedure from video acquirement, video coding, transmission, to video decoding and playing, which confirm the practicability and efficiency of above techeniques.
引文
1 沈兰荪.图像编码与异步传输.人民邮电出版社,1998:1~12
    2 田栋.低速率视频传输若干关键技术的研究.北京工业大学博士论文,2001:2~3
    3 毕厚杰.多媒体信息的传输与处理.人民邮电出版社,1999:3~8
    4 沈兰荪,卓力,田栋,汪孔桥.视频编码与低速率传输.电子工业出版社,2001:17~50
    5 钟玉琢等.基于对象的多媒体数据压缩编码国际标准.科学出版社,2000:14~36
    6 高文.多媒体数据压缩技术.电子工业出版社,1994:26~127
    7 G.Cote,B.Erol and M.Gallant.H.263+:Video Coding at Low Bit Rates.IEEE Trans Circuits and Systems for Video Tech,1998, 8(7):849~866
    8 K.R.Castleman.数字图像处理.朱志刚等译.电子工业出版社,1998:241~300
    9 容观澳.计算机图象处理.北京:清华大学出版社,2000
    10 W.Chen,C.H.Smith,and S.Fralick.A Fast Computational Algorithm for the Discrete Cosine Transform.IEEE Trans Communication,1977,COM-25(9):1004~1009
    11 K.Lengwehasatit and A.Ortega.DCT Computation Based on Variable Complexity Fast Approximations. http://v.brl.uiuc.edu/ICIP98/
    12 Yu-Tai Chang and Chin-Liang Wang.A New Fast DCT Algorithm and Its Systolic VLSI Implementation.IEEE Trans Circuits and Systems Ⅱ:Analog and Digital Signal Processing,1997,44(11): 959~962
    13 黄贤武等.数字图像处理与压缩编码技术.电子科技大学出版社,2000:449~456
    14 Ali Saman Tosun.Video Compression:MPEG-4 and Beyond.http ://www.cis.ohio-state.edu/
    15 ISO/IEC JTC1/SC29/WG11/N2932,MPEG-4 Video Verification Model,Ver.14.0.Oct 1999
    16 高文,吴枫.MPEG-4编码的现状和研究.计算机研究与发展,1999,36(6):641~652
    17 ISO/IEC JTC1/SC29/WG11 N4030,Overview of the MPEG-4 Standard.March
    
    2001
    18 ITU-T. Video Codec for Audiovisual Services at px64 kbits. Draft ITU-T Recommendation H.261. Jan 1993
    19 ITU-T. Video Coding for Low Bitrate Communication. Draft ITU-T Recommendation H.263. Mar 1996
    20 ITU-T. Video Coding for Low Bitrate Communication. Draft ITU-T Recommendation H.263 Version 2. Jan 1998
    21 ITU-T. Draft for "H.263++" Annexes U, V, and W to Recommendation H.263. Nov 2000
    22 D. Santa-Cruz and T. Ebrahimi. JPEG 2000 Still Image Coding Versus Other Standards. In: Proc. Of the SPIE's 45th, California, 2000:446-454
    23 王汇源,数字图像通信原理与技术,国防工业出版社, 2000:74-117
    24 Video Coding Standards H.26L. http://bs.Hhi.de/-wiegand/DIC.html
    25 Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG. Requirements for JVT Codec. Thailand, Dec.2001
    26 Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG. Removal of EOB Coding Redundancy. Geneva, Feb. 2002
    27 毋立芳,沈兰荪. MPEG-7 及其应用,测控技术, 2001,20(5) :1-4
    28 Jan. Bormans and Keith Hill. ISO/IEC JTC1/SC29/WG11/.N4318 MPEG-21 overview. July Sydney.2001
    29 田栋,姚志恒,沈兰荪,H.263的发展及应用,测控技术, 2001, 20 (5) : 5-12
    30 ITU-T/VCEG. H.26L Test Model Long-Term Number 9 (TML-9) draft0. Dec 2001
    31 Gary J. Sullivan, Thomas Wiegand, etal. Using The Draft H.26L Video Coding Standard for Mobile Application, http://www.lnt.e-technik.tu-muenchen.de/
    32 Yao Wang and Qin-Fan Zhu. Error Control and Concealment for Video Communication: a Review. In: Proc IEEE, 1998, 86(5) :974-997
    33 S.Dogan, A.H.Sadka and A.M.Kondoz. Error-resilient Techniques for Video Transmission Over Wireless Channels. http://www.ee.surrey.ac.uk/Personal/
    34 G. Bernd, F. Niko and S. Eckehard. Error-Resilient Coding for H.263. In: D. Bull, N. Canagarajah, A. Nix (eds), Insights into Mobile Multimedia Communication, Academic Press, 1999: 445-459
    35 W. P. Jong, W.K. Jong and U.L. Sang. DCT Coefficients Recovery-based Error Concealment Technique and Its Application to the MPEG-2 Bit Stream Error.
    
    IEEE Trans Circuits and Systems for Video Technology,Dec. 1997,7(6):845~854
    36 K.Stuhlmuller,M.Link and B.Girod.Scalable Internet Streaming With Unequal Error Protection.Packet video workshop 99,New York,April 1999
    37 M.Gallant and F.Kossentini.Rate-distortion Optimized Layered Coding with Unequal Error Protection for Robust Internet Video.IEEE Trans Circuits and Systems for Video Technology,2001,11(3):357~372
    38 王新梅,肖国镇.纠错码—原理与方法.西安电子科技大学出版社,2001:242~298
    39 罗明辉,朱秀昌,王厚大.基于H.263视频解码的误码掩盖技术研究.通信学报,1999,20(5):94~96
    40 龚时镠,朱秀昌.视频通信中的误码掩盖技术初探.电视技术,2000,6(216):71~73
    41 Y.J.Chung,J.Kim,C.-C.J.Kuo.Real-time Streaming Video with Adaptive Bandwidth Control and DCT-based Error Concealment. In:IEEE Trans Circuits and Systems Ⅱ:Analog and Digital Signal Processing,July 1999,46(7):951~956
    42 C.Kim;R.Kim and S.Lee.An Error Detection and Recovery Algorithm for Compressed Video Signal Using Source Level Redundancy.In:IEEE Trans Image Processing,Feb.2000,9(2):209~219
    43 T.J.Gareth,J.P.David and W.P.Iain.A Transform Domain Feature Detection and Concealment Algorithm for Errors in DCT Encoded Images.Computers and Graphics,2001,25(4): 671~680
    44 S.Shirani,F.Kossentini and R.Ward.An Adaptive Markov Random Field Based Error Concealment Method for Video Communication in an Error Prone Environment.In:IEEE Proc Inter Conf,Acoustics,Speech,and Signal Processing,1999,6:3117~3120
    45 S.Shirani,F.Kossentini and R.Ward.A Concealment Method for Video Communication in an Error Prone Environment. http://www.cs.ccu.edu.tw/
    46 M.Hong,H.Schwab,L.P.Kondi,etal.Error Concealment Algorithms for Compressed Video.Signal Processing:Image Communication,1999,14(8):473~492
    47 P.Yin,B.Liu,H.H.Yu.Error Concealment Using Data Hiding.In: Proc IEEE Int Conf ASSP,2001,3:1453~1456
    48 W.E.Lynch,V.Papadakis,R.Krishnamurthy and T.LeNgoc.Syntax Based
    
    Error Concealment. Signal Processing: Image Communication, 2001,16(9) : 827-835
    49 S.Valente, C.Dufour, F.Groliere, etal. An Efficient Error Concealment Implementation for MPEG-4 Video Streams. IEEE Trans Consumer Electronics, 2001,47(3) : 568-578
    50 K. Yoo. Low Complexity Error Concealment Method for the Transmission of H.263+ Coded Bitstream over Mobile Channels. http://www.research.att.com/-mrc/pv99/
    51 Y. LEE, Y. Altunbasak and R.Mersereau. A Temporal Error Concealment Method for MPEG Coded Video Using a Multi-frame Boundary Matching Algorithm. In: Proc Int Conf Image Processing, 2001, 1:990-993
    52 P. LEE and M. Chen. Robust Error Concealment Algorithm for Video Decoder IEEE Trans Consumer Electronics, 1999, 45( 3) : 851-859
    53 D. Kwon and P. Driessen. Error Concealment Techniques for H.263 Video Transmission. In: IEEE Proc Communications, Computers and Signal, 1999:276-279
    54 S. Jae-Won and H.Yo-Sung. Recovery of Motion Vectors for Error Concealment. In: Proc IEEE TENCON'99, 1999: 750-753
    55 Z. Jian, J.F. Arnold, M.R.Frater, etal. Video Error Concealment Using Decoder Motion Vector Estimation. In: Proc IEEE TENCON'97, 1997, 2: 777-780
    56 S. Shirani, F. Kossentini, and R.Ward. Error Concealment Methods, a Comparative Study. In: IEEE Conf Electrical and Computer Engineering, Canadian, 1999, 2: 835-840
    57 W.Jue and J.Liang. A Region and Data Hiding Based Error Concealment Scheme for Images. IEEE Trans on Consumer Electronics, May 2001, 47(2) :257-262
    58 I. Koji and M.Yutaka. Error Resilient Video Coding Schemes for Real-time and Low-bitrate Mobile Communication. Signal Processing: Image Communicatiorf, May, 1999, 14(6) : 519-530
    59 L. Pei-Jun and C. Mei-Juan. Robust Error Concealment Algorithm for Video Decoder. In: Inter Conf ICCE Consumer Electronics, 1999: 176-177
    60 L.Yuan-Chen, L.Ming-kuan, J.B. Niou, etal. A Novel Error Concealment Technique for MPEG-2 Video Decoder. In: Inter Conf ICCE Consumer Electronics, 2001: 158-159
    61 姚志恒,李博场,田栋,卓力,沈兰荪。MMX技术在视频编码中的应用,计
    
    算机与网络,2001,24:28~31
    62 蔡安妮,孙景鳌.多媒体通信技术基础.电子工业出版社,2000:58~69
    63 贾志科,崔慧娟,唐昆等.用于运动位移估值的新匹配准则.清华大学学报(自然科学版),1999,39(1):43~46
    64 A.C.N.Alan,B.Zeng.A New Fast Motion Estimation Algorithm Based on Search Window Sub-Sampling and Object Boundary Pixel Block Matching.Image Processing,ICIP98,1998:605~608
    65 D.Xu,C.Bailey and R.Sotudeh.An Improved Three-step Search Block-matching Algorithm for Low Bit-rate Video Coding Applications.In:Int Symposium on Signals,Systems,and Electronics,1998:178~181
    66 骆立俊,邹采荣,何振亚.一种新的视频编码的块运动估计算法.通信学报,2000,21(2):55~59
    67 Shan zhu and Kai-Kuang Ma.a New Diamond Search Algorithm for Fast Block-Matching Motion Estimation.IEEE Trans Image Processing,2000,9(2):287~290
    68 J.Feng,K.-T.Lo,H.Mehrpour,etal.Adaptive Block Matching Algorithm for Video Compression.In:IEE Proc Image and Signal Processing,July 1998,145(3):173~178
    69 H.Oh and H.Lee.Adaptive Adjustment of the Search Window for Block-matching Algorithm with Variable Block Size.In:IEEE Trans Consumer Electronics,Aug.1998,44(3):659~666
    70 兰军强,何芸,曹志刚.H.263中基于全零块发现的运动搜索方法.中国图像图形学报,2000,5(11):925~931
    71 王辉柏,张春田.基于头肩图像中脸部轮廓的运动估值.通信学报,1999,20(3):22~27
    72 洪波,庄健敏,余松煜.基于时空相关性的自适应运动估计方法.计算机工程,2000,28(8):50~52
    73 姚志恒,田栋,沈兰荪.基于H.263的实时视频编码技术研究.电路与系统学报,已录用
    74 Y.Alice,R.Lee and M.Flynn.Early Detection of All-zero Coefficient in H.263.PCS'97,Berlin,Germany,1997
    75 周璇,谭径微,余松煜.H.263中预先判别全零系数的新方法.上海交通大学学报,1998,32(9):107-109
    76 Tian Dong,Yao Zhiheng,Shen Lansun.A Prediction Based All-zero Block Detection Method for H.263.Journal of Electronics(China),2002,19(2):183-186
    
    
    77 Intel.MMX~(TM) Technology Overview.1996, ftp://download.intel.com
    78 Intel.Architecture Software Developer's Manual,Volume 1. 1997, ftp://download.intel.com
    79 Intel.IA-32 Intel Architecture Software Developer's Manual,Volume 2.2000,ftp://download.intel.com
    80 汪孔桥,J.A.Kangas.数字图像的质量评价.测控技术,2000,19(5):14-16
    81 Song Jianxin,Bi Houjie.Perceptual quality metric for compressed video.In:Proc Int Conference on Communication Technology,1998,1:S16-02-1~S16-02-5
    82 宋建新,毕厚杰.压缩视频感觉质量的计算.电子学报,2000,28(7):79~83
    83 王楠楠,李桂苓.符合人眼视觉特性的视频质量评价模型.中国图像图形学报,2001,6(6):523~527
    84 Tian Dong,Shen Lansun,Yao Zhiheng.Motion Activity Based Wireless Video Quality Perceptual Metric.In:Proc International Symposium on Intelligent Multimedia,Video & Speech Processing, Hong Kong,2001:527~530
    85 黄祥林,姚志恒,宋磊,沈兰荪.视频传输系统的实时性研究.已被第一届全国智能视觉监控学术会议录用

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700