视频压缩算法及基于嵌入式MPSOC的视频编码研究与实现
|
摘要
随着视频编码压缩技术的发展,特别是H.264标准的推出,以规则块为单位的视频压缩性能得到巨大提升。如何进一步提高视频编码性能,实现比H.264压缩效率高一倍的新一代视频编码方案,是视频领域近年来的研究重点之一。本文从非规则块模型的角度出发,对视频压缩中的双向预测帧、帧间运动模型和DCT变换等方面展开研究。
关键点滤波匹配是一种基于弹性模板的图像匹配方法,适合表达各种形变运动。但弹性模板对遮挡较为敏感,本文提出基于双向匹配的遮挡修止模型,有效改善部分遮挡区域的主观和客观质量；而针对图像边界匹配问题,本文提出一种无约束边界扩展模型,有效解决图像边界失配问题。
本文将基于关键点滤波匹配的图像插值用于解决视频编码中双向预测帧的压缩。首先对直接跳帧编码进行测试分析,结果表明在中低码率下,插值图像质量与传统B帧相当,总体码率可节省约5-15%。分析表明模型失效、线性插值和非线性运动的偏差是造成插值图像客观质量不高的原因。针对模型失效,提出带局部补偿的跳帧编码思想,实验结果表明带局部补偿的跳帧编码比传统B帧编码在中低码率下节省码率5-10%,图像质量略高于B帧；高码率下图像质量不如B帧,但可节省码率10-20%。针对线性插值和非线性运动失配问题,依据人眼对短时间间隔内运动特性不敏感的特点,提出带主观加权的图像质量评价准则,根据该准则,进一步证实跳帧编码在中低码率更具优势的特点。
传统规则块运动估计,不符合运动物体的不规则边界。本文提出混合块分割思想：大的规则块和小的不规则块分割相结合。据此提出基于折线的块分割方法,采用一条折线拟合规则块内的物体边界,从而提高运动估计的准确度,结果表明折线分割比传统规则块分割的性能增益约02.-0.3dB。传统二维DCT无法有效处理倾斜边界,本文提出重排DCT思想,先对像素块进行位置重排,再进行DCT,从而提高DCT系数集中性,结果表明在中高码率,性能提高0.1-0.2dB。此外,还提出重排DCT与不规则块分割相结合的编码方法,利用不规则块分割信息表达重排DCT的方向,减少所需比特数,结果表明重排DCT与不规则块分割相结合,在各个码率下,性能增益均到达0.2-0.3dB。
视频压缩性能的提高带来运算复杂度的急剧增大。嵌入式MPSOC作为一种并行计算的处理器系统,适合数据量大、运算复杂度高的视频信号处理,同时,嵌入式MPSOC也面临着存储资源有限、调度复杂等问题。本文以实验室自主研发的嵌入式多媒体MPSOC (MediaSOC3201A)为平台,以MPEG4编码为例,对嵌入式MPSOC在视频压缩中的存储优化、多核调度等相关问题进行研究。
针对数据空间优化,设计了基于宏块的编码策略,数据空间比基于宏块组的编码策略节省了约52.1%。针对单核程序存储空间不足的问题,提出一种基于主从结构的MPSOC程序覆盖机制,对于MPEG4编码,单核程序空间可节省33.6%。针对MPSOC中多处理器调度复杂的问题,提出一种面向对象的调度策略,将各个处理器上的软件模块进行统一封装,分离调度和数据通信,实现多核调度的统一化。将MPEG4编码分离为变长编码和其他功能两个模块,分配在不同处理器上,采用面向对象方法对编码过程进行调度,相对于基于程序覆盖的编码机制,编码效率提升33.19%。
With the development of video compression teconology, especially the emergment of H.264international standard, the performance of video encoding based on uniform block has been advanced. Int recent years, a hot spot in video domain is how to improve video compression performance further. In this dissertation, from the view point of non-uniform block model, we focus on the following fields:compression of the bi-directional predicted frame, the inter frame motion modeo and the discrete cosine transform.
Image matching using multiresolution critical point filters (CPF) is based on elastic model, which is effective in expressing non-translational motion. The elastic model is sensitive to occlusion, and we propose an occlusion refine modeo to release the part-occlusion problem in the interpolated image. To solve the boundary correspondence convergent problem, we propose an unconstrained boundary extension (UBE) approach, which can improve the visual quality of interpolated image at image boundary.
Image interpolation based on CPF matching is employed to compression of bi-directional predicted frame. By direct frame skip coding, the bit rate can be reduced by5-15%, while maintain comparative image quality at low and medium bitrate; At high bitrate, with a little loss of quality, direct frame skip coding can save about10-20%bit rate. To solve the model failure problem, we propose a frame skip coding method with local compensation (LC). With LC, the quality of skipped frame is enhanced, and the bit rate saving range from5%to20%at different bitrates, when compared to the traditional IBPBP coding structure.
Traditional motion estimation utilized rectangle based block partition, which does not fit with the curved edges of motion objects. To further reduce the error data after motion estimation, we propose a hybrid block partition approach, in which the image is first partitioned by uniform block, and then the uniform block is partitioned by a poly-line. Experimental results show that the polyline based partition method can improve the compression performance by0.2-0.3dB, compared to the tree structure based partition. Furthermore, to enhance the efficiency of2D-DCT, we propose a new DCT method, which is called Reorder DCT (RDCT). When combined with the hybrid partition approach, RDCT can achieve PSNR gain of0.2-0.3dB from low to high bitrate.
The improvement of compression efficiency also leads to the increasement of complexity. Multi-processors system on chip (MPSOC), a parallel computation system, is suitable for video compression. When applying MPSOC to video encoding, some problems need to be solved, which include memory optimization, schedule of multiple processors, and so on. In this dissertation, by implementing MPEG4encoder on the media MPSOC (MediaSOC3201A) designed by our lab, we research on the aspects of memory optimization and MPSOC schedule.
To overcome the drawback of a single processor with limited program memory, we develop a program overlap technique based on master-slave interaction mode. Results show that it can save the program memory size by33.6%for the slave processor responsible for MPEG4encoding. To simplfy the scheduling between different processors, we propose an object oriented scheduling model, according to the coarse grain data flow graph (CGDFG). By using the object oriented scheduling model, the encoding efficiency of MPEG4encoder can be enhanced by33.19%.
关键点滤波匹配是一种基于弹性模板的图像匹配方法,适合表达各种形变运动。但弹性模板对遮挡较为敏感,本文提出基于双向匹配的遮挡修止模型,有效改善部分遮挡区域的主观和客观质量；而针对图像边界匹配问题,本文提出一种无约束边界扩展模型,有效解决图像边界失配问题。
本文将基于关键点滤波匹配的图像插值用于解决视频编码中双向预测帧的压缩。首先对直接跳帧编码进行测试分析,结果表明在中低码率下,插值图像质量与传统B帧相当,总体码率可节省约5-15%。分析表明模型失效、线性插值和非线性运动的偏差是造成插值图像客观质量不高的原因。针对模型失效,提出带局部补偿的跳帧编码思想,实验结果表明带局部补偿的跳帧编码比传统B帧编码在中低码率下节省码率5-10%,图像质量略高于B帧；高码率下图像质量不如B帧,但可节省码率10-20%。针对线性插值和非线性运动失配问题,依据人眼对短时间间隔内运动特性不敏感的特点,提出带主观加权的图像质量评价准则,根据该准则,进一步证实跳帧编码在中低码率更具优势的特点。
传统规则块运动估计,不符合运动物体的不规则边界。本文提出混合块分割思想：大的规则块和小的不规则块分割相结合。据此提出基于折线的块分割方法,采用一条折线拟合规则块内的物体边界,从而提高运动估计的准确度,结果表明折线分割比传统规则块分割的性能增益约02.-0.3dB。传统二维DCT无法有效处理倾斜边界,本文提出重排DCT思想,先对像素块进行位置重排,再进行DCT,从而提高DCT系数集中性,结果表明在中高码率,性能提高0.1-0.2dB。此外,还提出重排DCT与不规则块分割相结合的编码方法,利用不规则块分割信息表达重排DCT的方向,减少所需比特数,结果表明重排DCT与不规则块分割相结合,在各个码率下,性能增益均到达0.2-0.3dB。
视频压缩性能的提高带来运算复杂度的急剧增大。嵌入式MPSOC作为一种并行计算的处理器系统,适合数据量大、运算复杂度高的视频信号处理,同时,嵌入式MPSOC也面临着存储资源有限、调度复杂等问题。本文以实验室自主研发的嵌入式多媒体MPSOC (MediaSOC3201A)为平台,以MPEG4编码为例,对嵌入式MPSOC在视频压缩中的存储优化、多核调度等相关问题进行研究。
针对数据空间优化,设计了基于宏块的编码策略,数据空间比基于宏块组的编码策略节省了约52.1%。针对单核程序存储空间不足的问题,提出一种基于主从结构的MPSOC程序覆盖机制,对于MPEG4编码,单核程序空间可节省33.6%。针对MPSOC中多处理器调度复杂的问题,提出一种面向对象的调度策略,将各个处理器上的软件模块进行统一封装,分离调度和数据通信,实现多核调度的统一化。将MPEG4编码分离为变长编码和其他功能两个模块,分配在不同处理器上,采用面向对象方法对编码过程进行调度,相对于基于程序覆盖的编码机制,编码效率提升33.19%。
With the development of video compression teconology, especially the emergment of H.264international standard, the performance of video encoding based on uniform block has been advanced. Int recent years, a hot spot in video domain is how to improve video compression performance further. In this dissertation, from the view point of non-uniform block model, we focus on the following fields:compression of the bi-directional predicted frame, the inter frame motion modeo and the discrete cosine transform.
Image matching using multiresolution critical point filters (CPF) is based on elastic model, which is effective in expressing non-translational motion. The elastic model is sensitive to occlusion, and we propose an occlusion refine modeo to release the part-occlusion problem in the interpolated image. To solve the boundary correspondence convergent problem, we propose an unconstrained boundary extension (UBE) approach, which can improve the visual quality of interpolated image at image boundary.
Image interpolation based on CPF matching is employed to compression of bi-directional predicted frame. By direct frame skip coding, the bit rate can be reduced by5-15%, while maintain comparative image quality at low and medium bitrate; At high bitrate, with a little loss of quality, direct frame skip coding can save about10-20%bit rate. To solve the model failure problem, we propose a frame skip coding method with local compensation (LC). With LC, the quality of skipped frame is enhanced, and the bit rate saving range from5%to20%at different bitrates, when compared to the traditional IBPBP coding structure.
Traditional motion estimation utilized rectangle based block partition, which does not fit with the curved edges of motion objects. To further reduce the error data after motion estimation, we propose a hybrid block partition approach, in which the image is first partitioned by uniform block, and then the uniform block is partitioned by a poly-line. Experimental results show that the polyline based partition method can improve the compression performance by0.2-0.3dB, compared to the tree structure based partition. Furthermore, to enhance the efficiency of2D-DCT, we propose a new DCT method, which is called Reorder DCT (RDCT). When combined with the hybrid partition approach, RDCT can achieve PSNR gain of0.2-0.3dB from low to high bitrate.
The improvement of compression efficiency also leads to the increasement of complexity. Multi-processors system on chip (MPSOC), a parallel computation system, is suitable for video compression. When applying MPSOC to video encoding, some problems need to be solved, which include memory optimization, schedule of multiple processors, and so on. In this dissertation, by implementing MPEG4encoder on the media MPSOC (MediaSOC3201A) designed by our lab, we research on the aspects of memory optimization and MPSOC schedule.
To overcome the drawback of a single processor with limited program memory, we develop a program overlap technique based on master-slave interaction mode. Results show that it can save the program memory size by33.6%for the slave processor responsible for MPEG4encoding. To simplfy the scheduling between different processors, we propose an object oriented scheduling model, according to the coarse grain data flow graph (CGDFG). By using the object oriented scheduling model, the encoding efficiency of MPEG4encoder can be enhanced by33.19%.
引文
[1]姚庆栋,徐孟侠等,图像编码基础(第3版),浙江大学出版社,2006年.
[2]T.Berger.Rate Distortion Theory.Prentice Hall,Englewood Cliffs,NJ,1984.
[3]张春田,苏育挺等,数字图像压缩编码,清华大学出版社,2006年.
[4]A.N.Netravali,B-Haskell.Digital Picture:Representation and Compression. Plenum Press,New York,1988.
[5]L. Torres, M. Kunt, Video coding:the second-generation approach.Boston:Kluwer Academic Publishers,1996.
[6]沈兰荪等.视频编码与低速率传输.北京：电子工业出版社,2002年.
[7]A.N.Netravali,B.Haskell.Digital Picture:Representation and Compression. Plenum Press,New York,1988.
[8]M.Antonini,M.Barlaud,P.Mathieu and I.Daubechies.Image coding using wavelet transform.IEEE Trans, on Image Processing,1992,1(4):205-220.
[9]H.J.Kim and C.C.Li.Lossless and lossy image compression using biorthogonal wavelet transforms with multiplierless operations.IEEE Trans, on Circuits and systems-II:Analog and Digital Signal Processing,1998,45(8):1113-1118.
[10]P. Willemin, T. Reed, M. Kunt, Image sequence coding by split and merge.IEEE Trans. on Commun,1991,39(12):1845-1855.
[11]R. Talluri, et al. A robust, scalable, object-based video compression technique for very low bit-rate coding. IEEE Trans, on Circuits Syst. Video Technol.,1997,7(1):221-233.
[12]S. Malassiotis, M.G. Strintzis. Object-based coding of stereo image sequence using three-dimensional models. IEEE Trans, on Circuits Syst. Video Technol.,1997, 7(6):892-905.
[13]S. C. Pei, C. W. Ko, M. S. Su. Global motion estimation in model-based image coding by tracking three-dimensional contour feature points. IEEE Trans, on Circuits Syst. Video Technol.,1998,8(2):181-190.
[14]何爱军,马争鸣.分形图像编码,中国图像图形学报,1999,4(3)：188-192.
[15]M.Kunt,A.Ikonomopoulos and M.Kocher. Second generation image coding techniques. Proceedings of IEEE,1985,73(4):549-575.
[16]P.Salembier. Region-based Video Coding Using Mathematical Morphology. Proc.of the IEEE,1995,83(6):843-856.
[17]L.Zhang. Tracking a face for knowledge-based coding of videophone sequences. Signal Processing: Image Communication,1997,10(7):93-114.
[18]D.Decarlo and D.Metaxas. Optical flow constraints on deformable models with applications to face tracking. International Journal of Computer Vision,2000,38(8): 99-127.
[19]N.Brady. MPEG-4 standardized methods for the compression of arbitrarily shaped video objects. IEEE Trans, on Circuits and Systems for Video Technology,1999,9(12): 1170-1189.
[20]T.Chang and C.C.J.Kuo.Texture analysis and classification with tree-structured wavelet wavelet transform.IEEE Trans.on Image Processing,1993,2(10):432-435.
[21]ITU-T Recommendation H.261, Video Codec for Audiovisual Services at px64 kbit/s. Mar.1993.
[22]MPEG-1 Commitee Draft. ISO/IEC JTCI/SC29/WGII, ISO/IEC CD 11172:Information technology. Dec.1991.
[23]Generic Coding of Moving Pictures and Associated Audio Information-Part 2:Video, TU-T and ISO/IEC JTC 1, ITU-T Recommendation H.262 and ISO/IEC 13 818-2 (MPEG-2),1994.
[24]ITU-T Recommendation H.263. Video Coding for Low Rate. May 1996.
[25]Sikora. MPEG-4 video standard verification model. IEEE Trans, on Circuit and System or Video Technology.1997,7(1):19-31.
[26]JVT Editors (T. Wiegand, G. Sullivan,A. Luthra), Draft ITU-T Recommendation and initial draft international standard of joint video specification (ITU-T Rec.H.264 ISO/IEC 14496-10 AVC), JVT-G050rl, Geneva, May 2003.
[27]S. Wenger, "H.264/AVC over IP," IEEE Trans. Circuits Syst. Video Technol.,2003, 13(7):45-656.
[28]T. Stockhammer, M. M. Hannuksela, and T. Wiegand, "H.264/AVC in wireless environments," IEEE Trans. Circuits Syst. Video Technol.,2003,13(7):657-673.
[29]G. Sullivan, "Meeting Report from Rapporteur", ITU-T Q.6/SG16 VCEG, VCEG-S01, 2003.
[30]G. Sullivan, "Some potential enhancements of H.264/AVC", ITU-T Q.6/SG16 VCEG, VCEG-T03,2003.
[31]G. Sullivan, "Potential enhancements of H.264/AVC", ITU-T Q.6/SG16 VCEG, VCEG-X03,2004.
[32]T. Wedi, "1/8-pel Displacement Vector Resolution for Interlaced Video Coding", Joint Video Team (JVT), JVT-B066, Geneva, CH, Jan.2002.
[33]T. Wedi, "Advanced motion comp methods", ITU-T Q.6/SG16 VCEG, VCEG-X10, 2004.
[34]J. Ostermann, M. Narroschke, "MCP with 1/8 pel MVs", ITU-T Q.6/SG16 VCEG, VCEG-AD09,2006.
[35]Y. Vatis, J. Ostermann, "P and B pics with 2-d nonsep Wiener interp.", ITU-T Q.6/SG16 VCEG, VCEG-AD08,2006.
[36]Y. Vatis, B. Edler, I. Wassermann, D. T. Nguyen and J. Ostermann, "Coding of Coefficients of two-dimensional non-separable Adaptive Wiener Interpolation Filter", VCIP 2005, Beijing,2005,5960:623-631.
[37]T. Wedi, "Adaptive Interpolation Filter for Motion Compensated Hybrid Video Coding," Proc. Picture Coding Symposium (PCS 2001), Seoul, Korea, April 2001.
[38]T. Wedi, "Adaptive Interpolation Filter for Motion and Aliasing Compensated Prediction," Proc. Electronic Imaging 2002:Visual Communications and Image Processing (VCIP 2002), San Jose, California USA, January 2002.
[39]Y. Vatis, B. Edler, D. T. Nguyen and J. Ostermann, "Motion-and Aliasing-compensated Prediction using a two-dimensional non-separable Adaptive Wiener Interpolation Filter,' Image Communications and Image Processing (ICIP), Genova, Italy, September,2005.
[40]M. Narroschke, H.G. Musmann, "Adaptive Prediction error coding in spatial and frequece domain", ITU-T Q.6/SG16 VCEG, VCEG-AB06,2006.
[41]M. Narroschke, H.G. Musmann, "Adaptive prediction error coding in spatial and frequence domain", ITU-T Q.6/SG16 VCEG, VCEG-AD07,2006.
[42]M. Narroschke, "Extending the prediction error coder by a vector quantizer", VCIP 2005, Beijing,2005,5960:2267-2278.
[43]A. Tanizawa, T. Chujoh, "Adaptive quant matrix", ITU-T Q.6/SG16 VCEG, VCEG-AC07.
[44]A. Tanizawa, T. Chujoh, "Adaptive quant matrix selection", ITU-T Q.6/SG16 VCEG, VCEG-AD06,2006.
[45]M. Karczewicz et al., "Improved Intra Coding," ITU-T Q.6/SG16 VCEG, VCEG-AF15.
[46]Y. Ye and M. Karczewicz, "Improved Intra Coding," ITU-T Q.6/SG16 VCEG, VCEG-AG11, October 2007.
[47]Y. Ye and M. Karczewicz, "Improved Intra Coding," ITU-T Q.6/SG16 VCEG, VCEG-AH20, January 2008.
[48]F. X. J. Lukas, Z. L. Budrikis:"Picture quality prediction based on a visual model." IEEE Trans, on Comm.1982,30(7):1679-1692.
[49]J. Lubin, D. Fibush:" Sarnoff JND vision model." TlA1.5 Working Group Document 97-612, T1 Standards Committee.1997.
[50]C. J. van den Branden Lambrecht, "Col or moving pictures quality metric."in Proc. ICIP, Lausanne, Switzerland,1996,1:885-888.
[51]S. Winkler:"Q uality metric design:A closer look." in Proc. SPIE, San Jose, CA,2000, 3959:37-44,.
[52]S. Winkler, P. Vandergheynst:"Computing isotropic local contrast from oriented pyramid decompositions." in Proc. ICIP, Kyoto, Japan,1999,4:420-424.
[53]A. B. Watson:"T oward a perceptual video quality metric." in Proc. SPIE, San Jose, CA, 1998,3299:139-147.
[54]X.K. Yang, W.S. Lin, Z.K Lu, X. Lin, S. Rahardja, E.P. Ong, and S.S. Yao, "Rate Control for Videophone Using Local Perceptual Cues" IEEE Trans, on Circuits Syst. Video Technol.,2005,15(4):496-507.
[55]C.W. Tang, "Spatiotemporal Visual Considerations for Video Coding", IEEE Trans, on Multimedia,2007,9(2):231-238.
[56]J.W. Chen, J.H. Zheng, S.L. Mei, Y. He, "Macroblock-Level Adaptive Frequency Weighting", IEEE Trans, on Consumer Electronics,2007,23(2):775-781.
[57]Y. Bandoh, "Mode decision for H.264/AVC based on spatio-temporal sensitivity", Picture Coding Symposium 2007, Novermber 2007.
[58]H. Brusewitz, "Motion compensation with triangles," Proc.3rd Inter. Conf on 64 kbit Coding of moving Video, Rotterdam, Netherlands, Sept.1990.
[59]Y. Nakaya and H. Harashima, "Motion compensation based on spatial tansformation", IEEE Trans, on Circuits Syst. Video Technol.1994,4(6):339-356.
[60]C. Toklu, A. T. Erdem, M. I. Sezan and A. M. Tekalp, "Tracking motion and intensity variations using hierarchical 2D mesh modelling for synthetic object transfiguration," Graph. Models Image Process.1996,58(6):553-573.
[61]Y. Altunbask and A. M. Tekalp, "Closed-form connectivity-Preserving solutions for motion compensation using 2-D meshes", IEEE trans, on Image Processing," 1997, 6(9):1255-1269.
[62]G. J. Sullivan and R. L. Baker, "Motion compensation for video compression using grid interpolation," in Proc. IEEE Int. Conference on Acoustics, Speech and Signal Processing, July 1991, p.2713-2716.
[63]C. L. Huang and C. Y. Hsu, "A new motion compensation method for image sequence coding using hierarchical grid interpolation," IEEE Trans, on Circuits Syst. Video Technol.,4(2):13-52.
[64]V. M.-Jimenez, A. Zergainoh, J.-P. Astruc, "Motion estimation method through adaptive deformable variable-sized rectangular meshes using warping function," Signal Processing and Information Technology,2006 IEEE International Symposium on, Aug.2006, p. 884-889.
[65]H. Pohsiang, K.J.R. Liu, T. Chen, "A low bit-rate video codec based on two-dimensional mesh motion compensation with adaptive interpolation," IEEE Trans, on Circuits and Systems for Video Technology,2001,11 (1):111-117.
[66]P. V. Beek, A. Tekalp, N. Zhang, I. Celasum and M. Xia,"Hierarchical 2D-mesh representation tracking and compression for object video," IEEE trans, on Image Processing,1999,9(3):353-369.
[67]G. Al-Regib, Y. Altunbasak, R. M. Mersereau, "Hierarchical Motion Estimation With Content-Based Meshes," IEEE Trans, on circuits ad systems for video technology,2003, 13(10):1000-1005.
[68]S..M. V.,T. Davies, "Affine motion compensation using a content-based mesh". IEE Proceeding on Vision, Image, and Signal Processing, August,2005.152:415-423.
[69]B.-T. Choi, S.-H. Lee, and S.-J. Ko, "New frame rate up-conversion using bi-directional motion estimation," IEEE Trans. Consum. Electron.,2000,46(3):603-609.
[70]M. T. Orchard and G.. J. Sullivan, "Overlapped block motion compensation: An estimation-theoretic approach," IEEE trans. Image Process.,1994,3(5):693-699.
[71]K. Hilman, H. W. Park, and Y. Kim, "Using motion-compensated frame rate conversion for the correction of 3:2 pulldown artifacts in video sequences," IEEE Trans. Circuits Syst. Video Technol.,2000,10(6):869-877.
[72]T. Ha, S. Lee, and J. Kim, "Motion compensated frame interpolation by new block-based motion estimation algorithm," IEEE Trans. Consum. Electron.,2004,50(2):752-759.
[73]S. Fujiwara, A. Taguchi, "Motion-compensated frame rate up-conversion based on block matching algorithm with multi-size blocks," in Proc. ISPACS 2005, Dec.2005, p. 353-356.
[74]B.-D. Choi, J.-W. Han, C.-S. Kim, and S.-J. Ko, "Motion-Compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation," IEEE Trans. Circuits Syst. Video Technol.,2007,17(4):407-416.
[75]R. Castagno, P. Haavisto, and G. Ramponi, "A method for motion adaptive frame rate up-conversion," IEEE Trans. Circuits Syst. Video Technol.,1996,6(5):436-446.
[76]B.-W. Jeon, G.-I. Lee, S.-H. Lee, and R.-H. Park, "Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure," IEEE Trans. Consum. Electron.,2003, 49(3):499-508.
[77]G.-I. Lee, B.-W. Jeon, R.-H. Park, and S.-H. Lee, "Hierarchical motion compensated frame rate up-conversion based on the gaussian laplacian pyramid," IEEE Int. Conf. Consum. Electron (ICCE'03), Jun.2007, p.350-351.
[78]F. C. M. Martins, "Real time frame rate adaptation based on warping of edge preserving meshes," IEEE Int. Conf. on Image Processing (ICIP 1999), Oct.1999,3:948-952.
[79]B.-D. Choi, J.-W. Han, C.-S. Kim, and S.-J., Ko, "Frame rate up-conversion using perspective transform," IEEE Trans. Consumer Electron.,2006,52(3):975-982.
[80]R. Krishnamurthy, J. W. Woods, and P. Moulin, "Frame interpolation and bidirectional prediction of video using compactly encoded optical-flow fields and label fields," IEEE Trans. Circuits Syst. Video Technol.,1999,9(5):713-726.
[81]Y. Altnubasak, and A. M. Tekalp, "Occlusion-adaptive, content-based mesh design and forward tracking," IEEE Trans. Image Process.,1997,6(9):1270-1280.
[82]D.-S. Huang, L. Heutte, and M. Loog, "Motion-Compensated Frame Rate Up-Conversion for Reduction of Blocking Artifacts," ICIC 2007, LNCS,2007,4681:938-949.
[83]G. Dane, T. Q. Nquyen, "Motion vector processing for frame rate up conversion," IEEE Int. Conf. Acoust. Speech, and Signal Proess. (ICASSP-2004), May,2004,3:309-312.
[84]M. E. Al-Mualla, "Motion field interpolation for frame rate conversion," Proc. Int. Sym. On Circuits and Systems (ISCAS'03), May 2003,2:652-655.
[85]S-H. Lee, O. Kwon, and R-H. Park, "Weighted-Adaptive Motion Compensated Frame Rate Up-Conversion", IEEE Transactions on Consumer Electronics,2003,49(3):485-492.
[86]R. Depommier, E. Dubois, "Motion estimation with detection of occlusion areas," IEEE Int. Conf. Acoust. Speech, and Signal Proess. (ICASSP-92), Mar.1992,3:269-272.
[87]M. J. W. Mertens, and G. de Haan, "A block based motion estimator capable of handling occlusions," Proc. IAPR Workshop on Machine Vision Applications, Tokyo, Nov.2000, p.28-30.
[88]O. Sanchez, "Tracking of an occluded object in a video sequence," in 7'th Int. Symposium Signal Process. And its application, July 2003,2:231-234.
[89]E. B. Beller, J. W. van Gurp, J. G. W. M. Janssen, R Braspenning, R Wittebrood, "Solving occlusion in frame-rate up-conversion," IEEE Int. Conf. Consum. Electron (ICCE'07), Jan.2007, p.1-2.
[90]Y.-K. Chen, A. Vetro, H. Sun, and S. Y. Kung, "Frame-rate up-conversion using transmitted true motion vectors," IEEE Second Workshop on Multimedia Signal Processing, Los Angels,1998, p.622-627.
[91]S. Sekiguchi, Y. Idehara, K. Sugimoto, and K. Asai, "A low-cost video frame-rate up conversion using compressed-domain information," IEEE Int. Conf. on Image Processing (ICIP 2005), Sep.2005,2:974-977.
[92]Y.-T. Yang, Y.-S. Tung, J.-L. Wu, "Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction," IEEE Trans. Circuits Syst. Video Technol.,2007,17(12):1700-1713.
[93]Y. Shinagawa and T. L. Kunii, "Unconstrained automatic image matching using multiresolutional critical-point filters," IEEE Trans, on Pattern Analysis and Machine Intelligence,1998,20(9):994-1010.
[94]K. Habuka, and Y. Shinagawa, "Image interpolation using enhanced Multiresolution Critical-Point Filters," International Journal of Computer Vision,2004,58(l):19-35.
[95]J. Durand, and S. Hutchinson, "Real-time object tracking using multiresolution critical point filters," in Proc. IEEE Int. Conf. Robots and Automation (ICRA'03), Sept.2003, 2:1682-1687.
[96]B. Chambers, J. Durand, N. Gans, and S. Hutchinson, "Dynamic feature point detection for visual servoing using multiresolution critical-point filters," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Oct.2003, p.504-509.
[97]A. A. Alatan, Y. Yemez, U. Gudukbay, X. Zabulis, K. Muller, C. E. Erdem, C. Weiqel, and A. Smolic, "Scene representation technologies for 3DTV—A survey", IEEE Trans. Circuits Syst. Video Technol.,2007,17(11):1587-1605.
[98]K. Yamamoto, M. Kitahara, H. Kimata, T. Yendo, T. Fujii, M. Tanimoto, S. Shimizu, K. Kamikura, and Y. Yashima, "Multiview video coding using view interpolation and color correction", IEEE Trans. Circuits Syst. Video Technol.,2007,17(11):1436-1449.
[99]S. Sekiguchi, S. Kato, S. Adachi and M. Etoh, "Low-overhead inter prediction modes" VCEG-N45, September 2001.
[100]S. Rondo, and H. Sasai, "A motion compensation technique using sliced blocks in hybrid video coding", IEEE Int. Conf. on Image Proc.-ICIP'05, Genova, Italy, September 2005, 2:305-308.
[101]E.M. Hung, R.L. De Queiroz, and D. Mukherjee, "On macroblock partition for motion compensation",2006 IEEE International Conference on Image Processing, October 2006, p.1697-1700.
[102]O. Divorra, P. Yin, and C. Gomila, "Geometry-adaptive block partitioning", ITU-T Q.6/SG16 VCEG, VCEG-AF10, April 2007.
[103]Oscar Divorra, Peng Yin, and Cristina Gomila, "Geometry-adaptiveBlock Partitioning on B-Frames", ITU-T Q.6/SG16 VCEG, VCEG-AG13, October 2007.
[104]0. Divorra, P. Yin, and C. Gomila, "Hierarchical B-Frame Results on Geometry-adaptive Block Partitioning", ITU-T Q.6/SG16 VCEG, VCEG-AH16, January 2008.
[105]K. Vermeirsch et.al, "New Macroblock Bipartitioning Modes for Inter Coding", ITU-T Q.6/SG16 VCEG, VCEG-AH25, Jan.2008.
[106]H. Xu, J.z. Xu, F. Wu, "Lifting-Based Directional DCT-Like Transform for Image Coding," IEEE Trans, on Circuits and Systems for Video Technology,2007, 17(10):1325-1335.
[107]B. Zeng and J.-J. Fu, "Directional discrete cosine transforms for image coding," in Proc. of IEEE ICME-2006, Toronto, Canada, July 2006, p.721-724.
[108]J. Fu and B. Zeng, "Directional Discrete Cosine Transforms:A Theoretical Analysis," IEEE International Conference on Acoustics, Speech and Signal Processing 2007. ICASSP 2007. April 2007,1.1105-1108.
[109]B. Zeng and J. Fu, "Directional Discrete Cosine Transforms—A New Framework for Image Coding," IEEE Trans, on Circuits and Systems for Video Technology,2008, 18(3):305-313.
[110]P. Kauff and K. Schuur, "Shape-adaptive DCT with block-based DC separation and'DC correction," IEEE Trans. Circuits and Systems for Video Technology,8(6):237-242.
[111]G. Shen, B. Zeng, and M. L. Liou, "Arbitrarily shaped transform coding based on a new padding technique," IEEE Trans. Circuits and Systems for Video Technology,2001, 11(1):67-78.
[112]G. Peyre and S. Mallat, "Discrete bandelets with geometric orthogonal Flters," IEEE International Conference on Image Processing (ICIP'05), Genes, Italy, sep.2005, 1:65-68.
[113]章弘,视频编解码预处理算法的研究与实现,浙江大学硕士学位论文,2008年.
[114]Z. B. Chen et.al, "Fast Motion Estimation for JVT", ITU-T Q.6/SG16, VCEG-G016, Mar. 2003.
[115]G. Bjontegaard, "Calculation of average PSNR differences between RD-Curves," ITU-T Q.6/SG16 VCEG, VCEG-M33, April 2001.
[116]V. Velisavljevic, B. B.-Lozano, M. Yetterli, P. L. Dragotti, "Approximation power of directionlets", IEEE International Conference on Image Processing,2005. ICIP 2005. Sept.2005,1:741-744.
[117]张春田,张劲松,“运动补偿视频编码中DCT编码效率的研究,”电子学报,1996,24(1)：1-5.
[118]D. Taubman and A. Zakhor, "Orientation adaptive subband coding of images," IEEE Trans, on Image Processing,1994,3(4):421-437.
[119]R. Bergamaschi, I. Bolsens, R. Gupta, et al., "Are single-chip multiprocessors in reach?," Design & Test of Computers, IEEE,2001,18(1):82-89.
[120]X. Cheng, "Heterogeneous multi-processor SoC:An emerging paradigm of embedded system design and its challenges," Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Xi'an, China,2005, p.3-3.
[121]C. Kozyrakis and D. Patterson, "Vector vs. superscalar and VLIW architectures for embedded multimedia benchmarks," Microarchitecture,2002.(MICRO-35). Proceedings. 35th Annual IEEE/ACM International Symposium on,2002. p.283-293.
[122]S. M. T. How, "Simultaneous Multithreading:A Platform for Next-Generation Processors," IEEE Micro,1997,17(5):12-19.
[123]D. Sweetman, See MIPS Run, Morgan Kaufmann,2006.
[124]T. Ungerer, B. Robi, and J. ilc, "A survey of processors with explicit multithreading," ACM Computing Surveys (CSUR),2003,35:29-63.
[125]章隆兵,何立强,“同时多线程结构研究综述,”信息技术快报,2004,8：1-12.
[126]J. J. Sharkey and D. V. Ponomarev, "Exploiting Operand Availability for Efficient Simultaneous Multithreading," IEEE Trans, on Computers,2007,56(2):208-223.
[127]D. T. Marr, F. Binns, D. L. Hill, G. Hinton, D. A. Koufaty, J. A. Miller, and M. Upton, "Hyper-Threading Technology Architecture and Microarchitecture," Intel Technology Journal,2002,6:4-15.
[128]D. M. Tullsen, S. J. Eggers, and H. M. Levy, "Simultaneous multithreading: Maximizing on-chip parallelism," Annual International Symposium on Computer Architecture, ISCA, Santa Margherita Ligure, Italy,1995, p.392-403.
[129]R. Kumar, D. M. Tullsen, N. P. Jouppi, et al., "Heterogeneous chip multiprocessors," Computer,2005,38(11):32-38.
[130]P. Kongetira, K. Aingaran, and K. Olukotun, "Niagara: a 32-way multithreaded Sparc processor," IEEE Micro,2005,25(2):21-29.
[131]R. Kalla, S. Balaram, and J. M. Tendler, "IBM Power5 chip:a dual-core multithreaded processor," Micro, IEEE, vol.24, issue.2, pp.40-47,2004.
[132]D. C. Pham, T. Aipperspach, D. Boerstler, et al., "Overview of the architecture, circuit design, and physical implementation of a first-generation cell processor," IEEE Journal of Solid-State Circuits,2006,41(1):179-196.
[133]S. Maeda, S. Asano, T. Shimada, et al., "A real-time software platform for the cell processor," IEEE Micro,2005,25(5):20-29.
[134]R. Hempel, "The MPI Standard for Message Passing," High-Performance Computing and Networking: International Conference and Exhibition, Munich, Germany, April 1994, 797:247-252.
[135]D. S. Nikolopoulos, "A transparent runtime data distribution engine for OpenMP," Scientific Programming,2000,8:143-162.
[136]A. E. Eichenberger, K. O'Brien, P. Wu, T. Chen, P. H. Oden, D. A. Prener, J. C. Shepherd, B. So, and Z. Sura, "Optimizing Compiler for a CELL Processor," 14th International Conference on Parallel Architectures and Compilation Techniques,2005. PACT 2005. Sept.2005, p.161-172.
[137]X. Tian, Y. K. Chen, M. Girkar, S. Ge, R. Lienhart, and S. Shah, "Exploring the use of Hyper-Threading technology for multimedia applications with Intel/spl reg/OpenMP compiler," Parallel and Distributed Processing Symposium,2003. Proceedings, April 2003, p.8-15.
[138]刘鹏MediaDSP3201/3202技术报告：浙大数芯MD3201/3202指令集用户手册[R].杭州：浙江大学,2003年.
[139]张贻雄,刘鹏,干维东,姚庆栋,俞国军,“一种基于像素自适应仲裁的OSD分层混合结构设计”,电路与系统学报,2008,30(4)：19-23.
[140]蒋志迪,可编程媒体处理系统芯片结构设计,浙江大学博士学位论文,2005年.
[141]俞国军,基于DSPs的媒体处理系统芯片设计研究,浙江大学博士学位论文,2006年
[142]R.G.Babbll, "Parallel Processing with Large Grain Data Flow Techniques," Computer, 1984,17(7):55-61.
[143]S.Y. Liao, S. Devades, K. Keutzer, "Code Density Optimization for Embedded DSP Processors Using Data Compression Techniques," IEEE Trans, on Computer-aided Design of Intergrated Circuits and Systems,1998.17(7):601-608.
[144]D.M. Li, Z.H. Li, "Parallel algorithm implementation of MPEG-4 video decoder on DSP[C]," Neural Network and Distributed Processing, Proceedings of SPIE,2001, 2555:148-153.
[145]P. K. Murthy, S. S. Bhattacharyya, "Shared buffer implementations of signal processing systems using lifetime analysis techniques," IEEE Trans, on Computer Aided Design of Integrated Circuits and Systems,2001,20(2):177-198.
[146]O. Hyunok, H. Soonhoi, "Data memory minimization by sharing large size buffers," Proceedings of the Asia and South Pacific Design Automation Conference, Yokohama, 2000, p.491-496.
[147]S. Steinke, N. Grunwald, L. Wehmeyer, R. Banakar, M. Balakrishnan, and P.Marwedel, "Reducing energy consumption by dynamic copying of instructions onto onchip memory," in Proc.15th Int. Symp. Syst. Syn. (ISSS),2002, p.213-218.
[148]C. Park et al., "Compiler Assisted Demand Paging for Embedded Systems with Flash Memory," Fourth Int. Conf. on Embedded Software (EMSOFT04), Pisa, Italy,2004, p.114-124.
[149]O. Avissar, R. Barua., "An Optimal Memory Allocation Scheme for Scratchpad-Based Embedded Systems," IEEE Trans, on Embedded Computing Systems,2002,1(1)6-26.
[150]M. Verma et al., "Dynamic Overlay of Scratchpad Memory for Energy Minimization," In Proceedings Int. Conf. HW/SW codesign and system synthesis,2004, p.104-109.
[151]H.-w. Park, K. Oh, S. Park, M.-m. Sim, S. Ha, "Dynamic Code Overlay of SDF-Modeled Programs on Low-end Embedded Systems," 2006 Proceedings of Design, Automation and Test in Europe, DATE'06, March 2006,1:1-2.
[152]S.S. Bhattacharyya, P.K. Murthy, and E.A. Lee, "APGAN and RPMC:Complementary Heuristics for Translating DSP Block Diagrams into Efficient Software Implementations[J]," Journal of Design Automation for Embedded Systems,1997, 2(1):33-60.
[153]P. G. Paulin, C. Pilkington, M. Langevin, E. Bensoudane, D. Lyonnard, O. Benny, B. Lavigueur, D. Lo, G. Beltrame, and V. Gagne, "Parallel programming models for a multiprocessor SoC platform applied to networking and multimedia," IEEE Trans, on Very Large Scale Integration (VLSI) Systems,2006,14(7):667-680.
[154]P. van der Wolf, E. de Kock, T. Henriksson, W. Kruijtzer, and G. Essink, "Design and programming of embedded multiprocessors:an interface-centric approach," Proceedings of the 2nd IEEE/ACM/IFIP international conference on Hardware/software codesign and system synthesis,2004, p.206-217.
[155]S. Kiran, M. N. Jayram, P. Rao, and S. K. Nandy, "A complexity effective communication model for behavioral modeling of signal processing applications," Proceedings of the 40th conference on Design automation,2003, p.412-415.
[156]M. Forsell, "A scalable high-performance computing solution for networks on chips," Micro, IEEE,2002,22:46-55.
[157]倪昕,基于媒体数字信号处理器的MPEG-4解码关键技术研究,浙江大学硕士学位论文,2006年.
[158]成杏梅,基于媒体芯片的实时操作系统实现研究,浙江大学博士学位论文,2008年.
[2]T.Berger.Rate Distortion Theory.Prentice Hall,Englewood Cliffs,NJ,1984.
[3]张春田,苏育挺等,数字图像压缩编码,清华大学出版社,2006年.
[4]A.N.Netravali,B-Haskell.Digital Picture:Representation and Compression. Plenum Press,New York,1988.
[5]L. Torres, M. Kunt, Video coding:the second-generation approach.Boston:Kluwer Academic Publishers,1996.
[6]沈兰荪等.视频编码与低速率传输.北京：电子工业出版社,2002年.
[7]A.N.Netravali,B.Haskell.Digital Picture:Representation and Compression. Plenum Press,New York,1988.
[8]M.Antonini,M.Barlaud,P.Mathieu and I.Daubechies.Image coding using wavelet transform.IEEE Trans, on Image Processing,1992,1(4):205-220.
[9]H.J.Kim and C.C.Li.Lossless and lossy image compression using biorthogonal wavelet transforms with multiplierless operations.IEEE Trans, on Circuits and systems-II:Analog and Digital Signal Processing,1998,45(8):1113-1118.
[10]P. Willemin, T. Reed, M. Kunt, Image sequence coding by split and merge.IEEE Trans. on Commun,1991,39(12):1845-1855.
[11]R. Talluri, et al. A robust, scalable, object-based video compression technique for very low bit-rate coding. IEEE Trans, on Circuits Syst. Video Technol.,1997,7(1):221-233.
[12]S. Malassiotis, M.G. Strintzis. Object-based coding of stereo image sequence using three-dimensional models. IEEE Trans, on Circuits Syst. Video Technol.,1997, 7(6):892-905.
[13]S. C. Pei, C. W. Ko, M. S. Su. Global motion estimation in model-based image coding by tracking three-dimensional contour feature points. IEEE Trans, on Circuits Syst. Video Technol.,1998,8(2):181-190.
[14]何爱军,马争鸣.分形图像编码,中国图像图形学报,1999,4(3)：188-192.
[15]M.Kunt,A.Ikonomopoulos and M.Kocher. Second generation image coding techniques. Proceedings of IEEE,1985,73(4):549-575.
[16]P.Salembier. Region-based Video Coding Using Mathematical Morphology. Proc.of the IEEE,1995,83(6):843-856.
[17]L.Zhang. Tracking a face for knowledge-based coding of videophone sequences. Signal Processing: Image Communication,1997,10(7):93-114.
[18]D.Decarlo and D.Metaxas. Optical flow constraints on deformable models with applications to face tracking. International Journal of Computer Vision,2000,38(8): 99-127.
[19]N.Brady. MPEG-4 standardized methods for the compression of arbitrarily shaped video objects. IEEE Trans, on Circuits and Systems for Video Technology,1999,9(12): 1170-1189.
[20]T.Chang and C.C.J.Kuo.Texture analysis and classification with tree-structured wavelet wavelet transform.IEEE Trans.on Image Processing,1993,2(10):432-435.
[21]ITU-T Recommendation H.261, Video Codec for Audiovisual Services at px64 kbit/s. Mar.1993.
[22]MPEG-1 Commitee Draft. ISO/IEC JTCI/SC29/WGII, ISO/IEC CD 11172:Information technology. Dec.1991.
[23]Generic Coding of Moving Pictures and Associated Audio Information-Part 2:Video, TU-T and ISO/IEC JTC 1, ITU-T Recommendation H.262 and ISO/IEC 13 818-2 (MPEG-2),1994.
[24]ITU-T Recommendation H.263. Video Coding for Low Rate. May 1996.
[25]Sikora. MPEG-4 video standard verification model. IEEE Trans, on Circuit and System or Video Technology.1997,7(1):19-31.
[26]JVT Editors (T. Wiegand, G. Sullivan,A. Luthra), Draft ITU-T Recommendation and initial draft international standard of joint video specification (ITU-T Rec.H.264 ISO/IEC 14496-10 AVC), JVT-G050rl, Geneva, May 2003.
[27]S. Wenger, "H.264/AVC over IP," IEEE Trans. Circuits Syst. Video Technol.,2003, 13(7):45-656.
[28]T. Stockhammer, M. M. Hannuksela, and T. Wiegand, "H.264/AVC in wireless environments," IEEE Trans. Circuits Syst. Video Technol.,2003,13(7):657-673.
[29]G. Sullivan, "Meeting Report from Rapporteur", ITU-T Q.6/SG16 VCEG, VCEG-S01, 2003.
[30]G. Sullivan, "Some potential enhancements of H.264/AVC", ITU-T Q.6/SG16 VCEG, VCEG-T03,2003.
[31]G. Sullivan, "Potential enhancements of H.264/AVC", ITU-T Q.6/SG16 VCEG, VCEG-X03,2004.
[32]T. Wedi, "1/8-pel Displacement Vector Resolution for Interlaced Video Coding", Joint Video Team (JVT), JVT-B066, Geneva, CH, Jan.2002.
[33]T. Wedi, "Advanced motion comp methods", ITU-T Q.6/SG16 VCEG, VCEG-X10, 2004.
[34]J. Ostermann, M. Narroschke, "MCP with 1/8 pel MVs", ITU-T Q.6/SG16 VCEG, VCEG-AD09,2006.
[35]Y. Vatis, J. Ostermann, "P and B pics with 2-d nonsep Wiener interp.", ITU-T Q.6/SG16 VCEG, VCEG-AD08,2006.
[36]Y. Vatis, B. Edler, I. Wassermann, D. T. Nguyen and J. Ostermann, "Coding of Coefficients of two-dimensional non-separable Adaptive Wiener Interpolation Filter", VCIP 2005, Beijing,2005,5960:623-631.
[37]T. Wedi, "Adaptive Interpolation Filter for Motion Compensated Hybrid Video Coding," Proc. Picture Coding Symposium (PCS 2001), Seoul, Korea, April 2001.
[38]T. Wedi, "Adaptive Interpolation Filter for Motion and Aliasing Compensated Prediction," Proc. Electronic Imaging 2002:Visual Communications and Image Processing (VCIP 2002), San Jose, California USA, January 2002.
[39]Y. Vatis, B. Edler, D. T. Nguyen and J. Ostermann, "Motion-and Aliasing-compensated Prediction using a two-dimensional non-separable Adaptive Wiener Interpolation Filter,' Image Communications and Image Processing (ICIP), Genova, Italy, September,2005.
[40]M. Narroschke, H.G. Musmann, "Adaptive Prediction error coding in spatial and frequece domain", ITU-T Q.6/SG16 VCEG, VCEG-AB06,2006.
[41]M. Narroschke, H.G. Musmann, "Adaptive prediction error coding in spatial and frequence domain", ITU-T Q.6/SG16 VCEG, VCEG-AD07,2006.
[42]M. Narroschke, "Extending the prediction error coder by a vector quantizer", VCIP 2005, Beijing,2005,5960:2267-2278.
[43]A. Tanizawa, T. Chujoh, "Adaptive quant matrix", ITU-T Q.6/SG16 VCEG, VCEG-AC07.
[44]A. Tanizawa, T. Chujoh, "Adaptive quant matrix selection", ITU-T Q.6/SG16 VCEG, VCEG-AD06,2006.
[45]M. Karczewicz et al., "Improved Intra Coding," ITU-T Q.6/SG16 VCEG, VCEG-AF15.
[46]Y. Ye and M. Karczewicz, "Improved Intra Coding," ITU-T Q.6/SG16 VCEG, VCEG-AG11, October 2007.
[47]Y. Ye and M. Karczewicz, "Improved Intra Coding," ITU-T Q.6/SG16 VCEG, VCEG-AH20, January 2008.
[48]F. X. J. Lukas, Z. L. Budrikis:"Picture quality prediction based on a visual model." IEEE Trans, on Comm.1982,30(7):1679-1692.
[49]J. Lubin, D. Fibush:" Sarnoff JND vision model." TlA1.5 Working Group Document 97-612, T1 Standards Committee.1997.
[50]C. J. van den Branden Lambrecht, "Col or moving pictures quality metric."in Proc. ICIP, Lausanne, Switzerland,1996,1:885-888.
[51]S. Winkler:"Q uality metric design:A closer look." in Proc. SPIE, San Jose, CA,2000, 3959:37-44,.
[52]S. Winkler, P. Vandergheynst:"Computing isotropic local contrast from oriented pyramid decompositions." in Proc. ICIP, Kyoto, Japan,1999,4:420-424.
[53]A. B. Watson:"T oward a perceptual video quality metric." in Proc. SPIE, San Jose, CA, 1998,3299:139-147.
[54]X.K. Yang, W.S. Lin, Z.K Lu, X. Lin, S. Rahardja, E.P. Ong, and S.S. Yao, "Rate Control for Videophone Using Local Perceptual Cues" IEEE Trans, on Circuits Syst. Video Technol.,2005,15(4):496-507.
[55]C.W. Tang, "Spatiotemporal Visual Considerations for Video Coding", IEEE Trans, on Multimedia,2007,9(2):231-238.
[56]J.W. Chen, J.H. Zheng, S.L. Mei, Y. He, "Macroblock-Level Adaptive Frequency Weighting", IEEE Trans, on Consumer Electronics,2007,23(2):775-781.
[57]Y. Bandoh, "Mode decision for H.264/AVC based on spatio-temporal sensitivity", Picture Coding Symposium 2007, Novermber 2007.
[58]H. Brusewitz, "Motion compensation with triangles," Proc.3rd Inter. Conf on 64 kbit Coding of moving Video, Rotterdam, Netherlands, Sept.1990.
[59]Y. Nakaya and H. Harashima, "Motion compensation based on spatial tansformation", IEEE Trans, on Circuits Syst. Video Technol.1994,4(6):339-356.
[60]C. Toklu, A. T. Erdem, M. I. Sezan and A. M. Tekalp, "Tracking motion and intensity variations using hierarchical 2D mesh modelling for synthetic object transfiguration," Graph. Models Image Process.1996,58(6):553-573.
[61]Y. Altunbask and A. M. Tekalp, "Closed-form connectivity-Preserving solutions for motion compensation using 2-D meshes", IEEE trans, on Image Processing," 1997, 6(9):1255-1269.
[62]G. J. Sullivan and R. L. Baker, "Motion compensation for video compression using grid interpolation," in Proc. IEEE Int. Conference on Acoustics, Speech and Signal Processing, July 1991, p.2713-2716.
[63]C. L. Huang and C. Y. Hsu, "A new motion compensation method for image sequence coding using hierarchical grid interpolation," IEEE Trans, on Circuits Syst. Video Technol.,4(2):13-52.
[64]V. M.-Jimenez, A. Zergainoh, J.-P. Astruc, "Motion estimation method through adaptive deformable variable-sized rectangular meshes using warping function," Signal Processing and Information Technology,2006 IEEE International Symposium on, Aug.2006, p. 884-889.
[65]H. Pohsiang, K.J.R. Liu, T. Chen, "A low bit-rate video codec based on two-dimensional mesh motion compensation with adaptive interpolation," IEEE Trans, on Circuits and Systems for Video Technology,2001,11 (1):111-117.
[66]P. V. Beek, A. Tekalp, N. Zhang, I. Celasum and M. Xia,"Hierarchical 2D-mesh representation tracking and compression for object video," IEEE trans, on Image Processing,1999,9(3):353-369.
[67]G. Al-Regib, Y. Altunbasak, R. M. Mersereau, "Hierarchical Motion Estimation With Content-Based Meshes," IEEE Trans, on circuits ad systems for video technology,2003, 13(10):1000-1005.
[68]S..M. V.,T. Davies, "Affine motion compensation using a content-based mesh". IEE Proceeding on Vision, Image, and Signal Processing, August,2005.152:415-423.
[69]B.-T. Choi, S.-H. Lee, and S.-J. Ko, "New frame rate up-conversion using bi-directional motion estimation," IEEE Trans. Consum. Electron.,2000,46(3):603-609.
[70]M. T. Orchard and G.. J. Sullivan, "Overlapped block motion compensation: An estimation-theoretic approach," IEEE trans. Image Process.,1994,3(5):693-699.
[71]K. Hilman, H. W. Park, and Y. Kim, "Using motion-compensated frame rate conversion for the correction of 3:2 pulldown artifacts in video sequences," IEEE Trans. Circuits Syst. Video Technol.,2000,10(6):869-877.
[72]T. Ha, S. Lee, and J. Kim, "Motion compensated frame interpolation by new block-based motion estimation algorithm," IEEE Trans. Consum. Electron.,2004,50(2):752-759.
[73]S. Fujiwara, A. Taguchi, "Motion-compensated frame rate up-conversion based on block matching algorithm with multi-size blocks," in Proc. ISPACS 2005, Dec.2005, p. 353-356.
[74]B.-D. Choi, J.-W. Han, C.-S. Kim, and S.-J. Ko, "Motion-Compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation," IEEE Trans. Circuits Syst. Video Technol.,2007,17(4):407-416.
[75]R. Castagno, P. Haavisto, and G. Ramponi, "A method for motion adaptive frame rate up-conversion," IEEE Trans. Circuits Syst. Video Technol.,1996,6(5):436-446.
[76]B.-W. Jeon, G.-I. Lee, S.-H. Lee, and R.-H. Park, "Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure," IEEE Trans. Consum. Electron.,2003, 49(3):499-508.
[77]G.-I. Lee, B.-W. Jeon, R.-H. Park, and S.-H. Lee, "Hierarchical motion compensated frame rate up-conversion based on the gaussian laplacian pyramid," IEEE Int. Conf. Consum. Electron (ICCE'03), Jun.2007, p.350-351.
[78]F. C. M. Martins, "Real time frame rate adaptation based on warping of edge preserving meshes," IEEE Int. Conf. on Image Processing (ICIP 1999), Oct.1999,3:948-952.
[79]B.-D. Choi, J.-W. Han, C.-S. Kim, and S.-J., Ko, "Frame rate up-conversion using perspective transform," IEEE Trans. Consumer Electron.,2006,52(3):975-982.
[80]R. Krishnamurthy, J. W. Woods, and P. Moulin, "Frame interpolation and bidirectional prediction of video using compactly encoded optical-flow fields and label fields," IEEE Trans. Circuits Syst. Video Technol.,1999,9(5):713-726.
[81]Y. Altnubasak, and A. M. Tekalp, "Occlusion-adaptive, content-based mesh design and forward tracking," IEEE Trans. Image Process.,1997,6(9):1270-1280.
[82]D.-S. Huang, L. Heutte, and M. Loog, "Motion-Compensated Frame Rate Up-Conversion for Reduction of Blocking Artifacts," ICIC 2007, LNCS,2007,4681:938-949.
[83]G. Dane, T. Q. Nquyen, "Motion vector processing for frame rate up conversion," IEEE Int. Conf. Acoust. Speech, and Signal Proess. (ICASSP-2004), May,2004,3:309-312.
[84]M. E. Al-Mualla, "Motion field interpolation for frame rate conversion," Proc. Int. Sym. On Circuits and Systems (ISCAS'03), May 2003,2:652-655.
[85]S-H. Lee, O. Kwon, and R-H. Park, "Weighted-Adaptive Motion Compensated Frame Rate Up-Conversion", IEEE Transactions on Consumer Electronics,2003,49(3):485-492.
[86]R. Depommier, E. Dubois, "Motion estimation with detection of occlusion areas," IEEE Int. Conf. Acoust. Speech, and Signal Proess. (ICASSP-92), Mar.1992,3:269-272.
[87]M. J. W. Mertens, and G. de Haan, "A block based motion estimator capable of handling occlusions," Proc. IAPR Workshop on Machine Vision Applications, Tokyo, Nov.2000, p.28-30.
[88]O. Sanchez, "Tracking of an occluded object in a video sequence," in 7'th Int. Symposium Signal Process. And its application, July 2003,2:231-234.
[89]E. B. Beller, J. W. van Gurp, J. G. W. M. Janssen, R Braspenning, R Wittebrood, "Solving occlusion in frame-rate up-conversion," IEEE Int. Conf. Consum. Electron (ICCE'07), Jan.2007, p.1-2.
[90]Y.-K. Chen, A. Vetro, H. Sun, and S. Y. Kung, "Frame-rate up-conversion using transmitted true motion vectors," IEEE Second Workshop on Multimedia Signal Processing, Los Angels,1998, p.622-627.
[91]S. Sekiguchi, Y. Idehara, K. Sugimoto, and K. Asai, "A low-cost video frame-rate up conversion using compressed-domain information," IEEE Int. Conf. on Image Processing (ICIP 2005), Sep.2005,2:974-977.
[92]Y.-T. Yang, Y.-S. Tung, J.-L. Wu, "Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction," IEEE Trans. Circuits Syst. Video Technol.,2007,17(12):1700-1713.
[93]Y. Shinagawa and T. L. Kunii, "Unconstrained automatic image matching using multiresolutional critical-point filters," IEEE Trans, on Pattern Analysis and Machine Intelligence,1998,20(9):994-1010.
[94]K. Habuka, and Y. Shinagawa, "Image interpolation using enhanced Multiresolution Critical-Point Filters," International Journal of Computer Vision,2004,58(l):19-35.
[95]J. Durand, and S. Hutchinson, "Real-time object tracking using multiresolution critical point filters," in Proc. IEEE Int. Conf. Robots and Automation (ICRA'03), Sept.2003, 2:1682-1687.
[96]B. Chambers, J. Durand, N. Gans, and S. Hutchinson, "Dynamic feature point detection for visual servoing using multiresolution critical-point filters," in Proc. IEEE/RSJ Int. Conf. Intelligent Robots and Systems, Oct.2003, p.504-509.
[97]A. A. Alatan, Y. Yemez, U. Gudukbay, X. Zabulis, K. Muller, C. E. Erdem, C. Weiqel, and A. Smolic, "Scene representation technologies for 3DTV—A survey", IEEE Trans. Circuits Syst. Video Technol.,2007,17(11):1587-1605.
[98]K. Yamamoto, M. Kitahara, H. Kimata, T. Yendo, T. Fujii, M. Tanimoto, S. Shimizu, K. Kamikura, and Y. Yashima, "Multiview video coding using view interpolation and color correction", IEEE Trans. Circuits Syst. Video Technol.,2007,17(11):1436-1449.
[99]S. Sekiguchi, S. Kato, S. Adachi and M. Etoh, "Low-overhead inter prediction modes" VCEG-N45, September 2001.
[100]S. Rondo, and H. Sasai, "A motion compensation technique using sliced blocks in hybrid video coding", IEEE Int. Conf. on Image Proc.-ICIP'05, Genova, Italy, September 2005, 2:305-308.
[101]E.M. Hung, R.L. De Queiroz, and D. Mukherjee, "On macroblock partition for motion compensation",2006 IEEE International Conference on Image Processing, October 2006, p.1697-1700.
[102]O. Divorra, P. Yin, and C. Gomila, "Geometry-adaptive block partitioning", ITU-T Q.6/SG16 VCEG, VCEG-AF10, April 2007.
[103]Oscar Divorra, Peng Yin, and Cristina Gomila, "Geometry-adaptiveBlock Partitioning on B-Frames", ITU-T Q.6/SG16 VCEG, VCEG-AG13, October 2007.
[104]0. Divorra, P. Yin, and C. Gomila, "Hierarchical B-Frame Results on Geometry-adaptive Block Partitioning", ITU-T Q.6/SG16 VCEG, VCEG-AH16, January 2008.
[105]K. Vermeirsch et.al, "New Macroblock Bipartitioning Modes for Inter Coding", ITU-T Q.6/SG16 VCEG, VCEG-AH25, Jan.2008.
[106]H. Xu, J.z. Xu, F. Wu, "Lifting-Based Directional DCT-Like Transform for Image Coding," IEEE Trans, on Circuits and Systems for Video Technology,2007, 17(10):1325-1335.
[107]B. Zeng and J.-J. Fu, "Directional discrete cosine transforms for image coding," in Proc. of IEEE ICME-2006, Toronto, Canada, July 2006, p.721-724.
[108]J. Fu and B. Zeng, "Directional Discrete Cosine Transforms:A Theoretical Analysis," IEEE International Conference on Acoustics, Speech and Signal Processing 2007. ICASSP 2007. April 2007,1.1105-1108.
[109]B. Zeng and J. Fu, "Directional Discrete Cosine Transforms—A New Framework for Image Coding," IEEE Trans, on Circuits and Systems for Video Technology,2008, 18(3):305-313.
[110]P. Kauff and K. Schuur, "Shape-adaptive DCT with block-based DC separation and'DC correction," IEEE Trans. Circuits and Systems for Video Technology,8(6):237-242.
[111]G. Shen, B. Zeng, and M. L. Liou, "Arbitrarily shaped transform coding based on a new padding technique," IEEE Trans. Circuits and Systems for Video Technology,2001, 11(1):67-78.
[112]G. Peyre and S. Mallat, "Discrete bandelets with geometric orthogonal Flters," IEEE International Conference on Image Processing (ICIP'05), Genes, Italy, sep.2005, 1:65-68.
[113]章弘,视频编解码预处理算法的研究与实现,浙江大学硕士学位论文,2008年.
[114]Z. B. Chen et.al, "Fast Motion Estimation for JVT", ITU-T Q.6/SG16, VCEG-G016, Mar. 2003.
[115]G. Bjontegaard, "Calculation of average PSNR differences between RD-Curves," ITU-T Q.6/SG16 VCEG, VCEG-M33, April 2001.
[116]V. Velisavljevic, B. B.-Lozano, M. Yetterli, P. L. Dragotti, "Approximation power of directionlets", IEEE International Conference on Image Processing,2005. ICIP 2005. Sept.2005,1:741-744.
[117]张春田,张劲松,“运动补偿视频编码中DCT编码效率的研究,”电子学报,1996,24(1)：1-5.
[118]D. Taubman and A. Zakhor, "Orientation adaptive subband coding of images," IEEE Trans, on Image Processing,1994,3(4):421-437.
[119]R. Bergamaschi, I. Bolsens, R. Gupta, et al., "Are single-chip multiprocessors in reach?," Design & Test of Computers, IEEE,2001,18(1):82-89.
[120]X. Cheng, "Heterogeneous multi-processor SoC:An emerging paradigm of embedded system design and its challenges," Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Xi'an, China,2005, p.3-3.
[121]C. Kozyrakis and D. Patterson, "Vector vs. superscalar and VLIW architectures for embedded multimedia benchmarks," Microarchitecture,2002.(MICRO-35). Proceedings. 35th Annual IEEE/ACM International Symposium on,2002. p.283-293.
[122]S. M. T. How, "Simultaneous Multithreading:A Platform for Next-Generation Processors," IEEE Micro,1997,17(5):12-19.
[123]D. Sweetman, See MIPS Run, Morgan Kaufmann,2006.
[124]T. Ungerer, B. Robi, and J. ilc, "A survey of processors with explicit multithreading," ACM Computing Surveys (CSUR),2003,35:29-63.
[125]章隆兵,何立强,“同时多线程结构研究综述,”信息技术快报,2004,8：1-12.
[126]J. J. Sharkey and D. V. Ponomarev, "Exploiting Operand Availability for Efficient Simultaneous Multithreading," IEEE Trans, on Computers,2007,56(2):208-223.
[127]D. T. Marr, F. Binns, D. L. Hill, G. Hinton, D. A. Koufaty, J. A. Miller, and M. Upton, "Hyper-Threading Technology Architecture and Microarchitecture," Intel Technology Journal,2002,6:4-15.
[128]D. M. Tullsen, S. J. Eggers, and H. M. Levy, "Simultaneous multithreading: Maximizing on-chip parallelism," Annual International Symposium on Computer Architecture, ISCA, Santa Margherita Ligure, Italy,1995, p.392-403.
[129]R. Kumar, D. M. Tullsen, N. P. Jouppi, et al., "Heterogeneous chip multiprocessors," Computer,2005,38(11):32-38.
[130]P. Kongetira, K. Aingaran, and K. Olukotun, "Niagara: a 32-way multithreaded Sparc processor," IEEE Micro,2005,25(2):21-29.
[131]R. Kalla, S. Balaram, and J. M. Tendler, "IBM Power5 chip:a dual-core multithreaded processor," Micro, IEEE, vol.24, issue.2, pp.40-47,2004.
[132]D. C. Pham, T. Aipperspach, D. Boerstler, et al., "Overview of the architecture, circuit design, and physical implementation of a first-generation cell processor," IEEE Journal of Solid-State Circuits,2006,41(1):179-196.
[133]S. Maeda, S. Asano, T. Shimada, et al., "A real-time software platform for the cell processor," IEEE Micro,2005,25(5):20-29.
[134]R. Hempel, "The MPI Standard for Message Passing," High-Performance Computing and Networking: International Conference and Exhibition, Munich, Germany, April 1994, 797:247-252.
[135]D. S. Nikolopoulos, "A transparent runtime data distribution engine for OpenMP," Scientific Programming,2000,8:143-162.
[136]A. E. Eichenberger, K. O'Brien, P. Wu, T. Chen, P. H. Oden, D. A. Prener, J. C. Shepherd, B. So, and Z. Sura, "Optimizing Compiler for a CELL Processor," 14th International Conference on Parallel Architectures and Compilation Techniques,2005. PACT 2005. Sept.2005, p.161-172.
[137]X. Tian, Y. K. Chen, M. Girkar, S. Ge, R. Lienhart, and S. Shah, "Exploring the use of Hyper-Threading technology for multimedia applications with Intel/spl reg/OpenMP compiler," Parallel and Distributed Processing Symposium,2003. Proceedings, April 2003, p.8-15.
[138]刘鹏MediaDSP3201/3202技术报告：浙大数芯MD3201/3202指令集用户手册[R].杭州：浙江大学,2003年.
[139]张贻雄,刘鹏,干维东,姚庆栋,俞国军,“一种基于像素自适应仲裁的OSD分层混合结构设计”,电路与系统学报,2008,30(4)：19-23.
[140]蒋志迪,可编程媒体处理系统芯片结构设计,浙江大学博士学位论文,2005年.
[141]俞国军,基于DSPs的媒体处理系统芯片设计研究,浙江大学博士学位论文,2006年
[142]R.G.Babbll, "Parallel Processing with Large Grain Data Flow Techniques," Computer, 1984,17(7):55-61.
[143]S.Y. Liao, S. Devades, K. Keutzer, "Code Density Optimization for Embedded DSP Processors Using Data Compression Techniques," IEEE Trans, on Computer-aided Design of Intergrated Circuits and Systems,1998.17(7):601-608.
[144]D.M. Li, Z.H. Li, "Parallel algorithm implementation of MPEG-4 video decoder on DSP[C]," Neural Network and Distributed Processing, Proceedings of SPIE,2001, 2555:148-153.
[145]P. K. Murthy, S. S. Bhattacharyya, "Shared buffer implementations of signal processing systems using lifetime analysis techniques," IEEE Trans, on Computer Aided Design of Integrated Circuits and Systems,2001,20(2):177-198.
[146]O. Hyunok, H. Soonhoi, "Data memory minimization by sharing large size buffers," Proceedings of the Asia and South Pacific Design Automation Conference, Yokohama, 2000, p.491-496.
[147]S. Steinke, N. Grunwald, L. Wehmeyer, R. Banakar, M. Balakrishnan, and P.Marwedel, "Reducing energy consumption by dynamic copying of instructions onto onchip memory," in Proc.15th Int. Symp. Syst. Syn. (ISSS),2002, p.213-218.
[148]C. Park et al., "Compiler Assisted Demand Paging for Embedded Systems with Flash Memory," Fourth Int. Conf. on Embedded Software (EMSOFT04), Pisa, Italy,2004, p.114-124.
[149]O. Avissar, R. Barua., "An Optimal Memory Allocation Scheme for Scratchpad-Based Embedded Systems," IEEE Trans, on Embedded Computing Systems,2002,1(1)6-26.
[150]M. Verma et al., "Dynamic Overlay of Scratchpad Memory for Energy Minimization," In Proceedings Int. Conf. HW/SW codesign and system synthesis,2004, p.104-109.
[151]H.-w. Park, K. Oh, S. Park, M.-m. Sim, S. Ha, "Dynamic Code Overlay of SDF-Modeled Programs on Low-end Embedded Systems," 2006 Proceedings of Design, Automation and Test in Europe, DATE'06, March 2006,1:1-2.
[152]S.S. Bhattacharyya, P.K. Murthy, and E.A. Lee, "APGAN and RPMC:Complementary Heuristics for Translating DSP Block Diagrams into Efficient Software Implementations[J]," Journal of Design Automation for Embedded Systems,1997, 2(1):33-60.
[153]P. G. Paulin, C. Pilkington, M. Langevin, E. Bensoudane, D. Lyonnard, O. Benny, B. Lavigueur, D. Lo, G. Beltrame, and V. Gagne, "Parallel programming models for a multiprocessor SoC platform applied to networking and multimedia," IEEE Trans, on Very Large Scale Integration (VLSI) Systems,2006,14(7):667-680.
[154]P. van der Wolf, E. de Kock, T. Henriksson, W. Kruijtzer, and G. Essink, "Design and programming of embedded multiprocessors:an interface-centric approach," Proceedings of the 2nd IEEE/ACM/IFIP international conference on Hardware/software codesign and system synthesis,2004, p.206-217.
[155]S. Kiran, M. N. Jayram, P. Rao, and S. K. Nandy, "A complexity effective communication model for behavioral modeling of signal processing applications," Proceedings of the 40th conference on Design automation,2003, p.412-415.
[156]M. Forsell, "A scalable high-performance computing solution for networks on chips," Micro, IEEE,2002,22:46-55.
[157]倪昕,基于媒体数字信号处理器的MPEG-4解码关键技术研究,浙江大学硕士学位论文,2006年.
[158]成杏梅,基于媒体芯片的实时操作系统实现研究,浙江大学博士学位论文,2008年.