摘要
可伸缩视频编码(Scalable Video Coding, SVC:本文主要指H.264/SVC)是指通过一次高压缩率编码,可以形成在时间上、空间上、质量上分层的多层码流,并可以根据应用场景、用户需求、网络环境和终端用户特征抽取所需要层的码流。SVC这种只提供唯一可伸缩的视频码流来支持多种设备和异构网络的技术优势非常适合视频监控系统的应用,为监控视频的压缩、存储和传输提供了强有力的技术支持。在视频监控领域中,交通监控是获取各种交通信息来解决交通问题的主要手段,人们的研究更多的集中在交通对象(主要是汽车)的分割、分析、识别与跟踪,交通特征参数的提取与分析,交通事件的识别与理解等领域,而针对交通监控视频进行压缩编码的研究相对较少。事实上,对于海量级别的交通监控视频更需要快速和高效的压缩编码技术,同时在编码阶段就要考虑压缩域与非压缩域视频检索等问题,因此,交通监控系统内的视频压缩不是一个普通的孤立的视频压缩问题,而是一个必须考虑预处理并且与视频/图像分析模块进行交互的系统问题,该问题已经成为视频压缩编码技术中的一个新兴研究领域,对于交通安防等领域有着巨大的应用价值。
鉴于此,本文研究面向交通监控应用的可伸缩视频编码,主要工作及研究成果在于:
1)提出适用于交通监控视频的时间可伸缩帧间快速编码算法
可伸缩视频编码采用分级B帧来实现时间伸缩性,其计算复杂度大大增加了编码时间,当前先进的改进算法可以将编码时间节省45%左右,但并未针对交通监控视频特点做进一步优化。对此,本文提出一种基于背景差分法的适合分级B帧的快速算法。首先通过改进的基于单高斯模型的时空背景建模方法获取背景图像;再求当前图像与背景图像的差值图像,通过滑动窗口去抖动算法正确获取运动区域;然后结合监控视频编码中影响分级B帧宏块模式选择的关键参数的统计数据分析,来缩减可能编码模式,从而提高编码速度。实验表明,本算法与标准算法比较,在保证编码效率和解码视频质量的前提下,编码时间可以平均节省约85%。
2)提出基于视觉注意模型的道路监控视频关键帧提取算法
对于日益剧增的海量交通监控视频,关键帧提取是和视频检索、摘要、浏览以及压缩编码都相关的一项重要技术。对此,本文首次提出一种基于视觉注意模型的道路监控视频关键帧提取算法。首先通过运动检测获取运动目标,以车牌和车辆最佳清晰度位置作为注意度评价标准,并提取运动目标位置显著度;然后提取运动目标的运动方向和强度显著度;接着用一种简单有效的车辆位置优先的自适应线性混合模式合成每帧图像的视觉注意度并生成最终的视觉注意度曲线;最后求出视觉注意度曲线的导数曲线,自适应滤波处理后在正值到负值变化的零交叉点中选取显著度最高的图像作为关键帧。实验证明,该算法提取的关键帧不但包括了所有经过监控的车辆最佳或接近最佳清晰度的位置,而且还能包括道路停车、超速和逆向行驶等各种交通事件,符合交通观察者的视觉特性。
3)提出跟踪感知下适于快速检索的均衡自适应GOP编码算法在关键帧获取的基础上,形成时间0级上的Ⅰ帧,对该类型Ⅰ帧中的交通事件和交通对象进行H.264/SVC监控信息扩展编码,并利用统一的语法和语义实现检索接口的标准化和统一化,从而极大的提高了压缩域内的检索速度和后期分析需要。但是这会引起Ⅰ帧位置的不定性,对分级B帧结构也造成一定程度的破坏,影响了帧间相关性和分级特性。对此,本文提出一种均衡自适应的GOP结构,并使用一种二叉树算法来实现任意大小GOP的时间分级特性。这样有利于检索和视频摘要的生成,但是由于部分Ⅰ帧的插入和监控信息扩展编码,率失真性能会有一定的损失,考虑到交通视频区别于一般的电视广播视频,其主要目的是在交通对象准确跟踪的基础上进行高层语义分析。对此,本文使用跟踪准确度代替PSNR来进行解码视频质量的度量,并通过优化变换系数的量化来去除更多对跟踪影响较小的码流。实验表明,在保证跟踪准确度相对准确的前提下,比传统方法可以减少约60%的码率。
4)提出适用于交通监控的内容自适应空间可伸缩视频编码算法
当前空间可伸缩编码系统很少考虑视频感兴趣区域(Region of Interest, ROI)或视觉突出内容,从而不能更好的适应视觉重要内容在较低分辨率移动终端的显示。对此,本文提出一种适用于交通监控的内容自适应空间可伸缩视频编码算法。首先使用背景差法获取运动车辆并进行目标跟踪,通常在交通监控中主导车辆(视觉上最突出的乍辆)所在运动窗为ROI,然后将该ROI设定为裁剪窗口(Cropping Window),使用H.264/SVC标准的扩展空间可伸缩方法(Extended Spatial Scalability, ESS)进行编码,并在空间增强层通过ROI分层量化策略和频域系数压缩矩阵的方法来进一步提高编码的率失真性能。实验表明,本算法与传统的二分下采样空间可伸缩算法相比,在率失真性能略有损失的情况下,对低分辨率空间层解码下的视觉感知有较大的改善。同样,在增强层仍可使用跟踪准确度代替SNR进行视频质量度量,在此标准下可以获得更高的编码性能提升。5)提出适于交通监控视频的容错编码与错误隐藏算法
3G技术的发展与4G/LTE技术的快速演进,使得异构环境下的各种移动与无线监控视频业务大大增加。由于移动无线信道的时变、高误码率、有限带宽等特点,其传输错误会严重影响SVC码流的解码质量。对此,本文提出空间可伸缩编码下基于反馈的错误跟踪(Error Tracking, ET)和参考帧选择(Reference Picture Selection, RPS)算法,结合了层间预测特性,并在选择帧内刷新(Intra Refresh)时考虑交通视频的视觉显著区域。并提出空间增强层帧级自适应错误隐藏算法,在对交通视频空间增强层宏块编码模式统计分析的基础上,利用基本层与帧间信息对增强层丢失宏块进行分析,自适应选择最佳的错误隐藏方法。如果使用跟踪准确度代替PSNR度量质量,由于压缩率大幅度提高,利用节省的码率增加冗余帧,在给定码率下,大大增加了解码视频的跟踪准确度。以上差错控制技术可以根据需求任意结合使用,为易错传输环境下接收视频的高层语义分析提供了有利的容错保障。
Scalable video coding (SVC, referring H.264/SVC in this paper) can form the temporal, spatial and SNR quality multilayer stream only by once high compression rate encoding, and the required layered bit steam can be extracted according to user needs, network environment and end-user features. This technical advantage is very suitable for the application of video surveillance system, and provides strong support for the compression, storage and transmission of the surveillance videos. In the field of video surveillance, traffic surveillance is the primary means to solve the traffic problems by extracting various traffic informations. More researches are focused on traffic objects segmentation, analysis, recognition and tracking, traffic characteristic parameters extraction and analysis, traffic events recognition and understanding, but the researches on the video compression coding of traffic surveillance are comparably few. In fact, the massive traffic surveillance videos need faster and more efficient compression encoding technology, and must consider the video retrieval etc. problems of compressed and non-compressed domain during encoding stage. Hence, the video compression of traffic surveillance is not an ordinary and isolated problem, but a system problem to pre-process and interact with the video/image analysis module. This issue has become an emerging research area, which has great applied values for traffic security etc. fields.
In view of this, the scalable video coding for traffic surveillance is studied in our paper, the main contents and novelties are as follows:
1) Fast inter prediction algorithm of temporal scalability for traffic surveillance video
Scalable video coding uses the hierarchical B frames to achieve temporal scalability, whose computational complexity significantly increases the coding time. The latest improved algorithm can save the coding time by about45%, but doesn't optimize for the traffic surveillance video features. In this paper a fast algorithm suitable for the hierarchical B frames based on the background difference method is proposed. First, the background image is gotten by the improved single Gaussian method based on spatio-temporal model. Second, the difference image is gotten by the current image subtracting the background image; the difference variances of each macro block and the sliding windows of the four directions are computed in order to remove the jitter effect, the motion region is acquire by comparing the minimal variance and the threshold. Then the analysis is processed by combining with the statistical data of the key parameters which will affect the macro block mode selection of the hierarchical B frames in the traffic surveillance to reduce the possible coding mode, so the coding speed is improved. The experimental results show that compared with the standard algorithm the proposed algorithm can save the coding time by about85%without degrading coding efficiency and decoding video quality.
2) Key frame extraction algorithm based on visual attention model
For the growing surge of massive traffic surveillance videos, key frame extraction is an important technology related to video retrieval, summary, browsing and compression. In this paper a key frame extraction algorithm based on visual attention model is proposed for lane surveillance video. First, the top-down method is used to detect moving objects whose position saliency is decided by the clearest position of license plates and vehicles. Then within the moving objects the bottom-up method is used to calculate the moving orientation and moving intensity saliency of the moving objects. Next the visual attention curve is fused by a simple adaptive linear mode. Last a derivative curve is generated, the frame with the most salient value in those zero-crossing points from the positive to the negative on derivative curve is selected as key frame. Experiments show that the key frames extracted by the proposed algorithm not only include the optimal or suboptimal positions of all passed vehicles, but also include on-street parking, speeding and reverse driving etc. traffic incidents. The results are consistent with the traffic observers'visual perception, and conducive to the extraction of vehicle static features to form the traffic video features database.
3) Tracking aware based proportionate GOP adaptation coding for fast retrieval
Base on the key frame extraction, the I-frames at the temporal0level are formed, in which the traffic events and traffic objects are encoded by the extended syntax and semantics as surveillance information of H.264/SVC. The unified defined syntax and semantic standardize the retrieval interface, which greatly improve the retrieval speed in the compressed domain and meet the post-analysis needs. But the key frames being encoded as I-frames will cause the uncertainty of the I-frame positions, thus the inter-frame correlation and temporal scalability of hierarchical B-picture are damaged in different degrees. In this paper the proportionate GOP adaptation structure is proposed, and the temporal scalability of any size GOP is realized by the proposed binary tree algorithm. This adaptive structure favors video retrieval and video summary generation, but there will be some loss of rate-distortion performance as part of the I-frame insertion. The traffic videos are different from the generic audiovisual services and broadcast television applications, its main aim is to analyze the high-level semantics based on the accurate traffic object tracking. Hence, the tracking accuracy instead of PSNR is utilized as the compression criterion, more low tracking interesting bit rate is reduced by optimizing the quantization of frequency coefficients. Experiments show that the method can save about60%bit rate compared with the conventional method while maintaining comparable tracking accuracy.
4) Content-adaptive traffic surveillance video coding with extended spatial scalability
Regions of interest (ROI) or visually salient regions are rarely considered in spatial scalable video coding, thus visually important content can not be better adapted to lower display resolutions. In this paper a content-adaptive spatial scalable coding for traffic surveillance video is proposed. First, the background image is extracted by an improved single Gaussian method. Then a background subtraction algorithm is present for detecting and tracking vehicles, the motion window of the leading vehicle is commonly referred to as ROI in traffic surveillance, and ROI is as cropping window in extended spatial scalability (ESS) of the scalable video coding (SVC). Moreover, we employ ROI-based quantization strategy and frequency coefficient suppression technique to improve the rate-distortion performance of enhancement spatial layer. The experimental results show that compared with the conventional scaling coding the proposed algorithm can greatly improve the visual perception of decoded base layer video with limited loss in rate-distortion performance. Also, the tracking accuracy instead of PSNR can be utilized as the compression criterion, by which the encoding performance can be improved more.
5) Error resilience and concealment algorithms for traffic surveillance video
By the development of3G and4G/LTE technology, the mobile and wireless video services increase significantly. Because of the time-varying, high bit error rate, limited bandwidth characteristics of mobile radio channels, the transmission errors will affect decoded quality of SVC bit stream. In this paper the feedback-based error tracking (ET) and reference picture selection (RPS) algorithms of the spatial scalability are proposed, which combine with the inter-layer prediction features. And in the choice of intra refresh, the visual salient regions of traffic videos are considered. Moreover, adaptive frame loss error concealment algorithm in spatial enhancement layer is proposed. Based on the statistical analysis of the enhancement layer macro block coding mode, the optimal error concealment method is adoptively chosen by using the basic layer and inter-frame information. If the tracking accuracy instead of PSNR is utilized as the compression criterion, the compression ratio is greatly improved. Part of the saving bit rate is utilized to introduce redundancy into the transmitted bit stream for error resilience. Under the given bit rate, the tracking accuracy of received video is greatly improved. The above error control techniques can be used in combination according to the requirements, which provide the conductive error resiliency for high-level semantic analysis of the transmitted bit stream in the error-prone channel.
引文
[1]Yang Yu, David Doermann. Model of object-based coding for surveillance video[C]. ICASSP,2005:693-696
[2]Wallace Kai-Hong Ho, Wai-Kong Cheuk, Lun, et al. Content-based scalable H.263 video coding for road traffic monitoring[J]. IEEE Transactions on Multimedia, 2005,7(4):615-623
[3]Nicolas, H. Scalable video compression scheme for tele-surveillance applications based on cast shadow detection and modeling[C]. ICIP,2005:493-496
[4]Babu, R.V., Makur, A., Sch. et al. Object-based surveillance video compression using foreground motion compensation[C].2006:1-6
[5]姜浩,郁梅,蒋刚毅,等.一种室内视频监控图像序列编码方法[J].光电工程,2008,35(4):79~83
[6]Wojtaszek D, Laganire R. Compressing surveillance video using motion segmentation[C]. ⅦP,2009:63-67
[7]William Robson Schwartz, Helio Pedrini and Larry S. Davis. Video compression and retrieval of moving object location applied to surveillance[J]. Image Analysis and Recognition,2009(5627):906-916
[8]汪大勇,孙世新,黄源源,等.一种适用于实时交通监控的视频编码方法[J].电子测量与仪器学报,2009,23(4):49~54
[9]刘雪冬.面向视觉监控的视频压缩研究[D],华中科技大学博士学位论文,2009.5
[10]汪大勇,孙世新,杨浩淼.适用于实时交通监控的时空可伸缩视频编码方法[J].光电子激光,2009,20(9):1214~1217,227
[II]Lai-Tee Cheok, Gagvani, N. Analytics-Modulated coding of surveillance video [C]. ICME,2010:127-132
[12]Zhang, Xianguo, Liang, Luhong, Huang, Qian, et al. An efficient coding scheme for surveillance videos captured by stationary cameras[J]. SPIE:Visual Communications and Image Processing,2010(7744):77442A1-77442A10
[13]Qinghua Li, Aixing Li, Fengqi Yu. Improved video compression for indoor video surveillance application[C]. ICACC,2010:452-455
[14]Fernandez, I.A., Alface, P.R., Tong Gan, et al. Integrated H.264 region-of-interest detection, tracking and compression for surveillance scenes[C]. PV,2010:17-24.
[15]张彦.基于交通对象视频压缩研究[D].北方工业大学硕士学位论文.2011,6
[16]刘雪冬,李庆,毛瑞雪.基于增强对象的监控视频编码算法[J].计算机工程,2011,37(13):224~226
[17]曹文伦.图像压缩及无线网络交通视频流媒体应用研究[D].西北工业大学博士学位论文.2006,10
[18]Carlotto M. J., Ackenhusen J. G., Suresh B. R. Track-based video compression[J]. Optical Engineering,2008(6981):69810I.1-69810I.6
[19]Zgaljic, T., Ramzan, N., Akram, M., et at. Surveillance centric coding[C]. Visual Information Engineering,2008:835-839
[20]Loomans, Marijn J. H., Koeleman and Cornelis J. Real-time scalable video codec implementation for surveillance[C]. ICME,2009:1130-1133
[21]Van Caenegem, R., Dooms, A., Barbarien J. and Schelkens, P. Design of an H.264/SVC resilient water-marking scheme[J]. SPIE:Visual Communications and Image Processing,2010(7542):16
[22]Meerwald, P. and Uhl A. Robust watermarking of H.264/SVC-encoded video: quality and resolution scalability[C]. IWDW,2010:1-4
[23]Meerwald, P. and Uhl, A. Robust watermarking of H.264-encoded video: Extension to SVC[C]. IIH-MSP,2010:10-13
[24]Zhu, B., Swanson, M., and Li, S. Encryption and authentication for scalable multimedia:Current state of the art and challenges[J]. SPIE:Internet Multimedia Management Systems,2004(5601):157-170
[25]Kim, Y. G., Jin, S. H. and Ro, Y. M. Scalable security and conditional access Control for multiple regions of interest in scalable video coding[C]. The 7th International Workshop on Digital Watermarking, LNCS,2008(5041):71-86
[26]Hosik Sohn, AnzaKu, E.T., De Neve, W., Yong Man Ro and Plataniotis, K.N. Privacy protection in video surveillance systems using scalable video coding[C]. AVSS,2009:424-429
[27]Zhao Shu-long, You Zhi-sheng, Lan Shi-yong, et al. An improved video compression algorithm for lane surveillance[C]. ICIG,2007:224-229
[28]William Robson Schwartz, Helio Pedrini and Larry S. Davis. Video compression and retrieval of moving object location applied to surveillance[J]. Image Analysis and Recognition,2009,5627:906-916
[29]http://www.avcon.com.cn/products.php?pid=25
[30]http://www.sunell.com.cn/jy_product.asp
[31]http://www.stretchinc.com/applications/surveillance.php
[32]http://www.radvision.com/Visual-Communications/Video-Communications-Techn ology/Scalable-Video-Coding/default.htm
[33]ITU-T and ISO/IEC JTC 1. Generic coding of moving pictures and associated audio information-Part 2:Video[S]. ITU-T Recommendation H.262 and ISO/IEC 13818-2 (MPEG-2 Video),1994
[34]ITU-T. Video coding for low bit rate communication[S]. ITU-T Recommendation H.263, Version 1:Nov.1995, Version 2:Jan.1998, Version 3:Nov.2000
[35]ISO/IEC JTC 1. Coding of audio-visual objects-Part 2:Visual[S]. ISO/IEC 14492-2 (MPEG-4 Visual), Version 1:Apr.1999, Version 2:Feb.2000, Version 3: May 2004
[36]Schwarz, H., Marpe, D., Wiegand, T. Overview of the scalable video coding extension of the H.264/AVC standard[J]. IEEE Trans.Circuits Syst. Video Technol.,2007,17(9):1103-1120
[37]T.Wiegand, G. Sullivan, J. Reichel, H. Schwarz, and M.Wien. Joint Draft 11 of SVC Amendment[S]. Joint Video Team, Doc. JVT-X201,2007
[38]WREN C, AZARBA Y A, DARREL T, et al. Pfinder:real-time tracking of the human body[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997,19 (7):780-785
[39]ELGAMMAL A, HARWOOD D, DAVIS L. Non-parametric model for background subtraction[J]. Lecture Notes in Computer Science,2000, 1843:751-767
[40]GUPTE S, MASOUD O, MARTIN R, et al. Detection and classification of vehicles[J]. IEEE Transactions on Intelligent Transportation Systems,2002, 3(1):37-47
[4l]杨珺,史忠科.基于改进单高斯模型法的交通背景提取[J].光子学报,2009,38(5):1293~1296
[42]汪大勇,孙世新,杨浩淼,等.适用于时间可伸缩的帧间快速编码算法[J].光电子.激光,2010,21(9):1374~1377
[43]SUN Y, AHMAD I, LI D D, et al. Region-based rate control and bit allocation for wireless video transmission[J]. IEEE Transactions on Multimedia,2006,8(1): 1-10
[44]汪海洋,潘德炉,夏德深.二维Otsu自适应闽值选取算法的快速实现[J].自动化学报,2007,33(9):968~971
[45]YEH C H, FAN K J, CHEN M J, et al. Fast mode decision algorithm for scalable video coding using bayesian theorem detection and markov process[J]. IEEE Transactions on Circuits and Systems for Video Technology,2010,20(4): 563-574
[46]SHEN L, SUN Y, LIU Z, et al. Efficient SKIP mode detection for coarse grain quality scalable video coding[J]. IEEE Signal Processing Letter,2010,17(10): 887-890
[47]PARK C S, DAN B K, CHOI H, et al. A statistical approach for fast mode decision in scalable video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology,2010,19(12):1915-1920
[48]HE L, LI Z G, CHANG Y W. Fast mode decision algorithm for inter frame coding in fully scalable video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology,2006,16(7):652-664
[49]LIM S H, YANG J Y, JEON B G. Fast coding mode decision for scalable video coding[C]. ICACT,2008:1897-1900
[50]VENKATRAMAN D, MAKUR A. A compressive sensing approach to object-based surveillance video coding[C]. ICASSP,2009:3513-3516
[51]Zhuang Y T, Rui Y, Huang Thomas S. Video key frame extraction by unsupervised clustering and feedback adjustment[J]. Journal of Computer Science and Technology,1999,14(3):283-287
[52]Hanjalic A, Zhang H J. An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis[J]. IEEE Transactions on Circuits and Systems for Video Technology,1999,9(8):1280-1289
[53]张婵,高新波,姬红兵.视频关键帧提取的可能性C_模式聚类算法[J].计算机辅助设计与图形学学报,2005,17(9):2040~2045
[54]王方石,须德,吴伟鑫.基于自适应阈值的自动提取关键帧的聚类算法[J].计算机研究与发展,2005,42(10):1752-1757
[55]Yang S P. Key frame extraction using unsupervised clustering based on a statistical model [J]. Tsinghua Science and Technology,2005,10(2):169-173
[56]Zeng X L, Hu W M, Li W Q. Key-frame extraction using dominant-set clustering [C]. ICME,2008:1285-1288
[57]Divakaran A, Radhakrishnan R, Peker K A. Motion activity-based extraction of key-frames from video shots[C]. ICIP,2002:1-932-1-935
[58]Liu T M, Zhang H J, Qi F H. A novel video key-frame-extraction algorithm based on perceived motion energy model [J]. IEEE Transactions on Circuits and Systems for Video Technology,2003,13(10):1006-1013
[59]W S Chau, O C Au, T S Chong. Key frame selection by macroblock type and motion vector analysis[C]. ICME,2004:575-578
[60]Yanzhuo Ma, Yilin Chang, and Hui Yuan. Key-frame extraction based on motion acceleration[J]. Optical Engineering,2008,47(9):090501-1-090501-3
[61]Itti L, Koch C. Feature combination strategies for saliency-based visual attention systems [J]. Journal of Electronic Imaging,2001,10 (1):161-169
[62]张鹏,王润生.基于视点转移和视区追踪的图像显著区域检测[J].软件学报,2004,15(6):891-898
[63]Ansgar R, Koene, Li Zhao-ping. Feature-specific interactions in salience from combined feature contrasts:Evidence for a bottom-up saliency map in V1[J]. Journal of Vision,2007,7(7):1-14
[64]D.A. Chernyak, L.W. Stark, Top-down guided eye movements[J]. IEEE Transaction on Systems, Man and Cybernetics,2001,31(4):514-522
[65]Ma YF, Hua X S,A generic framework of user attention model and its application in video summarization[J]. IEEE Transactions on Multimedia,2005,10(7): 907-919
[66]蒋鹏,秦小麟.基于视觉注意模型的自适应视频关键帧提取[J].中国图象图形学报,2009,14(8):1650~1655
[67]Jie-Ling Lai, Yang Yi. Key frame extraction based on visual attention model[J]. J.Vis.Commun.Image R,2012,23(1):114-125
[68]Huang-Chia Shih. Key-frame extraction and key-frame rate determination using human attention modeling[C]. ICME,2011:1-4
[69]http://iphome.hhi.de/suehring/tml
[70]http://opencv.willowgarage
[71]李松斌,陈君,王劲林.面向流媒体服务的视频资料元数据模型[J].电信科学,2008(11):41-46
[72]蒋薇,尔桂花,戴琼海.基于内容的视频查询系统研究[J].中国图象图形学报,2003,8(11):1320-1326
[73]李悦,覃团发.MPEG-7区域综合特征匹配的图像检索算法[J].中国图象图形学报,2009,14(9):1881~1885
[74]Kyoungro Y, Youngseop K, Je H P, etc. JPSearchrNew international standard providing interoperable framework for image search and sharing[J]. Signal Processing:Image Communication,2012(27):709-721
[75]Adami N, Leonardi R, Okuda M. Image coding with face descriptors embedding[C]. ICIP,2011:3665-3668
[76]Nicola A, Alberto B, Riccardo L, etc. Embedded indexing in scalable video coding[J]. Multimedia Tools and Applications,2010,48(1):105-121
[77]Ding Jun-Ren, Lin Ji-Kun, Yang Jar-Ferr. Motion-based adaptive GOP algorithms for efficient H.264/AVC compression[C]. JCIS,2006:1-4
[78]Ma Yanzhuo, Wan Shuai, Chang Yilin, Yang Fuzheng, Wang Xiaoyu. Adaptive GOP structure based on motion coherence[J]. SPIE, 2009(7455):74550T-1-74550T-8
[79]B Zatt, M Porto, J Scharcanski, S Bampi. GOP structure adaptive to the video content for efficient H.264/AVC encoding[C]. ICIP,2010:3053-3056
[80]Lenka Krulikovska. A novel method of adaptive GOP structure based on the positions of video cuts[C]. ELMAR,2011:67-70
[81]Paul Manoranjan, Lin Weisi, Lau Chiew-Tong, Lee Bu-Sung. Explore and model better I-frames for video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology,2011,21(9):1242-1254
[82]M W Park, G H Park, S Jeong, D Y Suh, K Kim. Adaptive GOP structure for joint scalable video coding[J]. IEICE Transactions on Communications, 2007(E90-B):431-434
[83]YiHau Chen, ChiaHua Lin, ChingYeh Chen. LiangGee Chen. Fast prediction algorithm of adaptive GOP structure for SVC[J]. SPIE-IS&T Electronic Imaging, 2007(6508):65080U-1-65080U-9
[84]Chen Hung Wei, Yeh ChiaHung, Chi MingChieh, Hsu ChingTing, Chen MeiJuan. Adaptive GOP structure determination in hierarchical B picture coding for the extension of H.264/AVC [C]. ICCCAS,2008:697-701
[85]Tian Song. Shinpei Matsuoka, Yoshitaka Morigami, Takashi Shimamoto. Coding efficiency improvement with adaptive GOP selection for H.264/SVC[J]. International Journal of Innovative Computing, Information and Control,2009, 5(11)(B):4155-4165
[86]Eren Soyak, Sotirios A. Tsaftaris, Aggelos K. Katsaggelos. Low-complexity tracking-aware H.264 video compression for transportation surveillance[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011,21(10):1378-1389
[87]M. B. A. Baumann, J. Ebling, M. Koenig, H. S. Loos, W. N. M. Merkel,J. K. Warzelhan, and J. Yu. A review and comparison of measures for automatic video surveillance systems[J]. EURASIP J. Image Video Process,2008(824726):30
[88]C. Andrew Segall and Gary J. Sullivan. Spatial scalability within the H.264/AVC scalable[J]. IEEE Trans.Circuits Syst. Video Technol.,2007,17(9):1121-1135
[89]E. Francois and J. Vieron. Extended spatial scalability:a generalization of spatial scalability for non-dyadic configurations[C]. ICIP,2006:169-172
[90]P. Krahenbiihl, M. Lang, A. Hornung, and M. Gross. A system for retargeting of streaming video[C]. Proc. ACM SIGGRAPH Asia,2009:Article No.126
[91]Rubinstein, M., Shamir, A., and Avidan, S. Improved seam carving for video retargeting[J]. ACM Transaction on Graphics,2008,27(3):Article No.16
[92]A. Smolic, Y. Wang, N. Stefanoski, M. Lang, A. Hornung and M. Gross. Non-linear warping and warp coding for content-adaptive prediction in advanced video coding applications[C]. ICIP,2010:4225-4228
[93]Y. Wang, N. Stefanoski, X. Fang, A. Smolic. Content-adaptive spatial scalability for scalable video coding[C]. PCS,2010:226-229
[94]Yongzhe Wang; Stefanoski. N.; Lang. M.; Hornung, A.; Smolic, A.; Gross, M. Extending SVC by content-adaptive spatial scalability[C]. ICIP,2011:3493-3496
[95]Beymer D, McLauchlan P, Coifman B, et al. A real-time computer vision system for measuring traffic parameters[C]. CVPR,1997:495-501
[96]Tai J C, Tseng S T. Real-time image tracking for automatic traffic monitoring and enforcement applications[J]. Image and Vision Computing,2004,22(10):485-501
[97]Roya R, Mansour J. Real-time classification and tracking of multiple vehicles in highways[J]. Pattern Recognition Letters,2005,26(10):1597-1607
[98]纪筱鹏,魏志强.基于轮廓特征及扩展Kalman滤波的车辆跟踪方法研究[J].中国图象图形学报,2011,11(2):267~272
[99]Wang Y, Zhu Q. Error control and concealment for video communication:a review[J]. Proc. IEEE,1998,86(5):974-997
[100]GIROD B, FARBER N. Feedback-based error control for mobile video transmission[J], Proc. IEEE,1999,87(10):1707-1723
[101]WENGER S. H.264/AVC over IP[J]. IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7):645-656
[102]Kumar S, Xu L, Mandal M K, et al. Error resiliency schemes in H.264/AVC standard[J]. Journal of Visual Communication and Image Representation,2006, 17(2):425-450
[103]Li Song, Xin M. Improving flexible macroblock ordering of H.264/AVC[C]. ICME,2009:742-745
[104]Barak Katz, Shlomo Greenberg, Nathalie Yarkoni, Nathan Blaunstien, and Ran Giladi. New error-resilient scheme based on FMO and dynamic redundant slices allocation for wireless video transmission [J]. IEEE Transactions On Broadcasting, 2007,53(1):308-319
[105]Jantana Panyavaraporn 1 and Rhandley D. Cajote. Flexible macroblock ordering based on region of interest for H.264/AVC wireless video transmission[C]. IWSSIP,2012:384-387
[106]李勃,卓力,沈兰荪.基于Intra帧刷新的差错控制新方法[J].电路与系统学报,2005,10(5):110~113
[107]Ali I, Fleury M, Ghanbari M. Content-aware intra-refresh for video streaming over lossy links[C]. ICCE.2012:118-119
[108]Wang Xiaolong, Cui Huijuan, Tang Kun. Attention-based adaptive intra refresh method for robust video coding[J]. Tsinghua Science and Technology,2012, 17(1):67-72
[109]Dissanayake M.B., Hewage C.T.E., Worrall S.T., Fernando W.A.C., Kondoz A.M. Redundant motion vectors for improved error resilience in H.264/AVC coded video[C]. ICME,2008:25-28
[110]Pierre Ferre, Dimitris Agrafiotis, David Bull. Macroblock selection algorithms for error resilient H.264 Video[J]. SPIE:Visual Communications and Image Processing,2008(6822):68220S-1-68220S-8
[111]Ye-Kui Wanga, Chunbo Zhub and Houqiang Lib. Error resilient video coding using flexible reference frames[J]. SPIE:Visual Communications and Image Processing,2005(5960):596022-1-596022-12
[112]柳林,张引,张三元.叶修梓G对话式视频业务中H.264/AVC的容错策略[J],中国图象图形学报,2006,11(9):1223~1229
[113]Ghandi M.M., Barmada B., Jones E.V., Ghanbari M. Wireless video transmission using feedback-controlled adaptive H.264 source and channel coding[J]. IET Communications,2009,3(2):172-184
[114]Fan Li, Yixin Gao. ROI-based error resilient coding of H.264 for conversational video communication[C]. IWCMC,2011:1719-1723
[115]Baccichet P., Bagni D., Chimienti A., Pezzoni L., Rovati F.S. Frame concealment for H.264/AVC decoders[J]. IEEE Transactions on Consumer Electronics,2005, 51(1):227-233
[116]Shih-Chia Huang, Sy-Yen Kuo. Optimization of hybridized error concealment for H.264[J]. IEEE Transactions on Broadcasting,2008,54(3):499-516
[117]Shihua Cui, Huijuan Cui, Kun Tang. An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering[J]. SIViP, 2012(10):10
[118]Jie Jiang, Baolong Guo, Wei Mo. Efficient intra refresh using motion affected region tracking for surveillance video over error prone networks[C]. ISDA,2008: 242-246
[119]Yiran Zhou, Qi Zhang. An efficient FMO-based error-resilient scheme for video surveillance coding[J]. Multimed Tools Appl,2012(3):21
[120]JVT of ISO/IEC MPEG & ITU-T VCEG. CABAC variants and options for bit error-resilience, JVT-P023[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, 2005
[121]JVT of ISO/IEC MPEG & ITU-T VCEG. Error resilience using frame numbers in key pictures, JVT-U116[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6, 2006
[122]JVT of ISO/IEC MPEG & ITU-T VCEG. Improved error resilience using frame index in NAL header extension for SVC, JVT-V088[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6,2007
[123]JVT of ISO/IEC MPEG & ITU-T VCEG. Parameter set CRC SEI message, JVT-S037[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6,2006
[124]JVT of ISO/IEC MPEG & ITU-T VCEG. Error resiliency SEI message, JVT-T023[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6,2006
[125]JVT of ISO/IEC MPEG & ITU-T VCEG. Improved error resilience using temporal level 0 picture index, JVT-W062[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6,2007
[126]JVT of ISO/IEC MPEG & ITU-T VCEG. Implementation of redundant pictures in JSVM, JVT-Q054[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6,2005
[127]JVT of ISO/IEC MPEG & ITU-T VCEG. SVC/AVC sliding window XOR-based redundant picture for error resilience, JVT-X056[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6,2007
[128]Jia Jie, Kim Hae-Kwang, Choi Hae-Chul. Polyphase downsampling based redundant picture coding for SVC error resiliency[C]. CISP,2008,90-94
[129]阎金,全子一,门爱东.可分级视频编码结构优化的差错恢复编码方法[J].北京邮电大学学报,2007,30(3):32~35
[130]Guo Y, Chen Y, Wang Y K, et al. Error resilient coding and error concealment in scalable video coding[J]. IEEE Transactions on Circuits and Systems for Video Technology,2009,19(6):781-795
[131]Dieu Thanh Nguyen, Hayashi, M., Ostermann J. Adaptive error protection for scalable video coding extension of H.264/AVC[C]. ICME,2008:417-420
[132]Hellge C., Schierl T., Wiegand T. Mobile TV using scalable video coding and layer-aware forward error correction[C]. ICME.2008:1177-1180
[133]Walid S. Ibrahim Ali, Rony Ferzli. Efficient error frame loss recovery model for scalable video coding[J]. SPIE:Image Processing Algorithms and Systems, 2010(7532):75320J-1-75320J-9
[134]Hellge C., Gomez-Barquero D., Schierl T., Wiegand T. Layer-aware forward error correction for mobile broadcast of layered media[J]. IEEE Transactions on Multimedia,2011,13(3):551-562
[135]CHEN Ying, XIE Kai, ZHANG Feng, PANDIT Purvin, BOYCE Jill. Frame loss error concealment for SVC[J]. Journal of Zhejiang University SCIENCE A,2006 7(5):677-683
[136]Li-na Zhang, Chun Yuan, Yu-Zhuo Zhong. A novel SVC VoD system with rate adaptation and error concealment over GPRS EDGE network[C]. CISP,2008: 349-354
[137]Chun-Su Park, Hyeong-Min Nam, Seung-Won Jung, Seung-Jin Baek, Sung-Jea Ko. Practical error concealment strategy for video streaming adopting scalable video coding[J]. IEEE Transactions on Consumer Electronics,2009,55(3):1606-1613
[138]Qirong Ma, Feng Wu, Jian Lou, Ming-Ting Sun. Frame loss error concealment for spatial scalability using hallucination[C]. PV,2009:1-10
[139]Shoaib M. Key picture error concealment using residual motion-copy in scalable video coding[C]. CSIE,2009:591-595
[140]Lam S.J.Q., Cajote R.D., Aramvith S. Improvement on error concealment for H.264 spatial scalable video coding[C]. ICGCS,2010:533-538
[141]Brandas M., Martini M.G., Uitto M., Vehkapera J. Quality assessment and error concealment for SVC transmission over unreliable channel[C]. ICME,2011:1-6
[142]Pao-Chi Chang, Tien-Hsu Lee. Precise and fast error tracking for error resilient transmission of H.263 video[J]. IEEE Transactions on Circuits and Systems for Video Technology,2000,10(4):600-607
[143]JVT of ISO/IEC MPEG & ITU-T VCEG. SVC/AVC loss simulator donation, JVT-Q069[S]. ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6,2005