用户名: 密码: 验证码:
图像\视频特效制作的若干关键技术研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
影视特效体现了视觉技术和艺术相结合的新发展,已成为当代电影的一种有效的表现手法,是创意实现不可或缺的技术保证。近年来,视频特效处理技术层出不穷,本文对经典的视频抠像-合成技术和卡通化技术进行研究。
     视频抠像-合成技术是视频特效制作中必不可少的关键技术,广泛应用于媒体制作中。目前,抠像技术的研究相对比较成熟,为了达到实时、高质量抠像的目的,我们采用图像分割与抠像相结合的方案——基于二值分割的贝叶斯抠像方法。该方法主要步骤包括:基于背景建模的背景减除、贝叶斯估计生成Trimap、Graphcut分割、贝叶斯抠像。准确的抠像结果是完美合成的保障,根据抠像中提取的前景颜色信息和像素点不透明度值,将提取出的前景融合到新背景中,这样就完成了整个抠像与合成。实验证明,我们的抠像-合成方法可以得到高质量的处理结果,而且不透明度对于模糊物体(如头发,羽毛等)的提取非常有效,我们还采用分割与抠像并行处理的机制来保证实时处理。
     影视艺术的卡通化,满足了现代人对视觉新鲜感的需求,使影视创作迈进了一个全新的艺术阶段。在形式多样的卡通动画制作中,将实际拍摄的视频,通过卡通化特效自动生成卡通视频的技术越来越受到人们的关注。本文我们采用一种基于特征的视频图像抽象化方法处理视频,该方法主要包括:重要性图计算、RGB与CIE-Lab颜色空间转换、快速双边滤波、亮度值伪量子化、各向异性的高斯差分线条抽取及线条增强。该方法的每一步都可以在图形卡硬件中并行处理,可以自动、快速的生成卡通视频。此外,我们将重要性图计算应用到卡通化处理中,保证了对重要性区域的细致刻画,符合人们的视觉习惯。我们的卡通化方法还有效地解决了现有视频和图像抽象化方法存在的抽取线条生硬,不连贯的问题,为非专业人员提供了一种简便直观的视频和图像的抽象化方法。
     本文中我们还应用以上两项技术的结合处理视频,即将视频中的前景(如人物)提取出来,然后对前景元素进行卡通风格化处理后,再合成到全新的场景中,这样也使得视频制作更加多样化。在未来的影视制作中也会得到越来越广泛的应用。
     本文的创新之处在于引入了重要性图计算到卡通化中,并将抠像-合成与卡通化处理相结合进行视频特效制作。
Video special effect shows the combination of visual technology and art new development. It has become an effective expression technique of modern film and been an essential technology to ensure the creative implementation. In recent years, video effects processing technology emerge in endlessly. In our paper, we study two classic special effects technology-video matting-compositing and video cartoon.
     Video matting-compositing is a key technology in film production. In order to meet the requirements of real-time and high quality processing, we combine image segmentation and matting options-Bayesian video matting based on binary segmentation. The first step employs binary segmentation to generate a trimap. Given the trimaps, matting algorithms are then applied in the second step to refine the foreground boundary and extract alpha matte. The whole video matting process is automatically performed on PC.Experimental results on various test videos show the effectiveness of our method.
     Television cartoon art meets the needs of visual freshness, expands the creative way of film art. Our paper employs anisotropic difference-of-Gaussian (DoG) line extraction method based on feature-flow, which includes six main parts:importance map calculation, RGB and CIE-Lab color space conversion, fast bilateral filtering with bilateral grid, pseudo-quantization, anisotropic DoG, line enhancement technologies. Every step of the algorithm can conduct parallel processing on the PC graphics card. As our video extraction is based on anisotropic algorithm, it resolves the problem that the extracted lines are stiff and incoherent. In addition, we calculate importance map to ensure the detailed description for important area. This can generates a layering screen to meet people's visual habits.
     In our paper, we apply the combination of above two technologies to process videos: extract foreground from real video, do cartoon-style processing, then synthesize foreground into a new background. This makes the film elements more diverse.
引文
[1]Smith AR and Blinn JF, "Blue screen matting".In Proceedings of SIGGRAPH96,1996,page 259-268.
    [2]战国科,夏哲雷.基于支持向量机的飞机图像识别方法[J].现代电子技术,2007(21):127—129.
    [3]刘进.不变量特征的构造及在目标识别中的应用[D].华中科技大学,2004.
    [4]Berman A, Dardourian A, Vlahos P. Method for Removing From an Image the Background Surrounding a Selected Object [P].U.S.Patent,6,134,346,2000.
    [5]Berman A, Vlahos P, Dardourian A. Comprehensive Method for Removing From an Image the Background Surrounding a Selected Object [P].U.S. Patent,6,134,345,2000.
    [6]Chuang YY, Curless B, Salesin DH, and Szeliski R. A bayesian approach to digital matting. In Proceeding of CVPR'2001, volume 2,page 264-271.IEEE,2001.
    [7]Fishkin K, Barsky B.A family of new algorithms for soft filling[J].Comp Graph,1984,18(3):235-244.
    [8]Mitsunaga T, Yokoyama T, Totsuka T. Auto Key:Human assisted key extraction [C],In SIGGRAPH95,1955,265-272.
    [9]J.B.Adams and M.O.Smith, "Spectral mixture modeling:A new analysis of rock and soil types at the Viking Lander 1 suite——J. Geophys. Res.,vol. 91 (B8),pp.8098-8112,Jul.10,1986.
    [10]Porter T, Duff T. Compositing digital images[C].In SIGGRAPH84,1984,253-259.
    [11]Ruzon MA and Tomasi C.Alpha estimation in natural images.In Proceedigns of CVPR'2000,2000.
    [12]Sun J,Jia J,Tang C K,and Shum HY.Poisson matting.ACM Transactions on Graphics,23(3):315-321,2004.
    [13]Wang J, Cohen M F. An iterative optimization approach for unified image segmentation and matting [C]. Proc of ICCV,2005,2:936-943.
    [14]Levin A, Lischinski D, Weiss Y. A Closed From Solution to Natural Image Matting [C]. Proc of IEEE CVPR,2006,61-68.
    [15]Zongker DE, Werner DM,Curless B,and Salesin DH.Environment matting and compositing. In Proceedings of SIGGRAPH'1999,1999.
    [16]Zhu J and Yang YH. Frequency-based environment matting. In Proceedings of Pacific Graphics'2004,2004.
    [17]Chuang YY, Zongker D,Hindorff J, Curless B,Salesin D,and Szeliski R.Extensions to environment matting:towards higher accuracy and real time capture.In Proceedings of SIGGRAPH'2000,2000.
    [18]Peers P and Dutre P.Wavelet environment matting.In Eurographics Symposium on Rendering 2003,2003.
    [19]Boykov Y and Jolly M-P.Interactive graph cuts for optimal boundary region segmentation of objects in N-D images.In Proceedings of ICCV 2001,2001.
    [20]Rother C, Kolmogorov V, and Blake A. "grabCut"-Interactive Foreground Extraction using Iterated Graph Cuts. ACM Transactions on Graphics (SIGGRAPH'04),2004.
    [21]Greig D,Porteous B,and Seheult A.Exact maximum a posteriori estimation for binary images.Journal of the Royal Statistical Society,Series B,51(2):271-279,1989.
    [22]Juan O and Boykov Y.Active graph cuts.In Proceedings of CVPR'2006,2006.
    [23]Wang S and Siskind JM.Image segmentation with minimum mean cut.In Proceedings of ICCV'2001,volume 1,page 517-524,2001.
    [24]Li Y,Sun J,and Shum H-Y.Video object cut and paste.ACM TOG,24(3):595-560,2005.
    [25]Ruzon MA and Tomasi C.Alpha estimation in natural images.In Proceedigns of CVPR'2000,2000.
    [26]Vincent L and Soille P. Watersheds in digital spaces:an efficient algorithm based on immersion simulations. IEEE PAMI,13(6):583-598,1991.
    [27]Chuang YY, Agawala A, Curless B, Salesin DH, and Szeliski R. Video matting of complex scenes. ACM TOG,21(3):243-248,July 2002.
    [28]Black MJ and Anandan P. The robust estimation of multiple motions:Parametric and piecewise-smooth flow fields. Computer Vision and Image Understanding, 63(1):75-104,1996.
    [29]Drori I, Leyvand T, Fleishman S, Choen-Or D, and Yeshurun H. Video operations in the gradient domain. Technical report, TAU,2004.
    [30]Wang J, Cohen M F. Image and video matting:a survey [J].Foundations and Trends in Computer Graphics and Vision,2008,3(2):97-175.
    [31]Lin Shengyou, Shi Jiaoying.Perceptual color space based natural image matting [J]. Journal of Computer-Aided Design & Computer Graphics,2005,17(5):915-920.(in Chinese)(林生佑,石教英.基于感知颜色空间的自然图像抠图[J].计算机辅助设计与图形学学报,2005,17(5):915-920).
    [32]Levin A, Lischinski D, Weiss Y. A closed form solution to natural image matting [C]. P Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New York,2006,1:61-68.
    [33]Porter T and Duff T. Compositing digital images.ACM TOG,18(3):253-259,1984.
    [34]Liu J F, Chen Y Q. Gao W Mapping learning in eiganspace for harmonious caricature generation 2006.
    [35]Kulkarn P. Interactive caricature generation using frontal photographs 2002.
    [36]Arad N, Reisfel D. Image warping using few anchor functions pints and radial 1995(1).
    [37]D.Decarlo and A.Santella.Stylization and Abstraction of Photographs.In Proceedings of the ACM SIGGRAPH, pp.769-776,2002.
    [38]Wang J, Thiesson B, Xu Y, Cohen M. Image and video segmentation by anisotropic kernel mean shift 2004.
    [39]H.Winnemoller, S.C.Olsen, and B.Gooch, "Real-Time Video Abstraction", in Proceedings of the ACM SIGGRAPH,2006, pp 1221-1226.
    [40]J.E.Kyprianidis and J.Dollner, "Image abstraction by structure adaptive filtering",in Proc.EG UK Theory and Practice of Computer Graphics,pp.51-58,2008.
    [41]H.Kang, S.Lee, C.K.Chui, "Flow-based image abstraction",IEEE Transactions on Visualization and Computer Graphics, vol.15, no.1,pp.62-76,2009.
    [42]S.Paris, "Edge-preserving smoothing and mean-shift segmentation of video stream,"in ECCV08,pp. Ⅱ:460-473,2008.
    [43]G.R.Greenfield and D.H.House, "Image Recoloring Induced by Palette Color Associations," In Proceedings of WSCG 2003, pp.137-145, February,2003.
    [44]Y.Chang, S.Saito,and M.Nakajima,"A framework for transfer colors based on the basic color categories",Computer Graphics International Conference,pp.176-181,2003.
    [45]Hertzmann A, Jacobs CE, Oliver N, Curless B, Salesin DH. Image analogies. In ACM SIGGRAPH'01,pp.327-340,2001.
    [46]E.Reinhard, M.Ashikhmin, B.Gooch, and P.Shirley. Color transfer between images.IEEE Comput.Graph.Appl.,vol.21,no.5,pp.34-41,2001.
    [47]Y.-H.H.Chuang-Ming Wang and Y.-H.Huang, "An effective algorithm for image sequence color transfer",Mathematical and Computer Modelling,vol.44,no.7-8,pp.608-627,2006.
    [48]S.Baker,S.Roth,D.Scharstein,M.Black,J.Lewis,and R.Szeliski. A database and evaluation methodology for optical flow. In International Conference on Computer Vision,pp.1-8,2007.
    [49]T.Q.Pham, L.J.V.Vliet, "Separable bilateral filtering for fast video preprocessing", in IEEE International Conference on Multimedia & Expo, CD 1-4(2005).
    [50]P.Perona, J.Malik, "Scale-Space and Edge Detection Using Anisotropic Diffusion", IEEE Transactions on Pattern Analysis and Machine Intelligence, v.12 n.7, p.629-639, July 1990.
    [51]赵汉理,金小刚.一种基于特征的实时的视频和图像抽象化方法.中国,浙江大学,200810062384.4,pp.3-12.,2008.5.15.
    [52]Sun J,Jia J,Tang C K,and Shum HY.Poisson matting.ACM Transactions on Graphics, 23(3):315-321,2004.
    [53]Chuang YY, Curless B, Salesin DH, and Szeliski R. A bayesian approach to digital matting. In Proceeding of CVPR'2001, volume 2,page 264-271.IEEE,2001.
    [54]Boykov Y and Jolly M-P.Interactive graph cuts for optimal boundary region segmentation of objects in N-D images.In Proceedings of ICCV'2001,2001.
    [55]Rother C, Kolmogorov V, and Blake A. "grabCut"-Interactive Foreground Extraction using Iterated Graph Cuts. ACM Transactions on Graphics (SIGGRAPH'04),2004.
    [56]Shi J,Fowlkes C,Martin D,et al.Graph based image segmentation tutorial[OL],2009.
    [57]Wang Jue, Cohen M F. Optimized color sampling for robust matting[C].Proc of IEEE Conference on Computer Vision and Pattern Recgnition.2007:1-8.
    [58]Perez P, Gangnet M, Blake A. Poisson image editing[A]. In:Proceedings of ACM SIGGRAPH[C], San Diego, CA, USA.2003:313-318.
    [59]Boykov Y and Jolly M-P.Interactive graph cuts for optimal boundary region segmentation of objects in N-D images.In Proceedings of ICCV'2001,2001.
    [60]V. Q. Pham, K. Takahashi, T. Naemura, "Live video segmentation in dynamic backgrounds using thermal vision". In Proc. Pacific-Rim Symposium on Image and Video Technology. (Jan.2009) 143-154.
    [61]Boykov, Y., Jolly, M.:Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images. In:Proc. ICCV. Volume Ⅰ. (2001) 105-112.
    [62]Mishima Y. Soft edge chroma-key generation based upon hexoctahedral color space:U.S.,5355174[P].994-10-11.
    [63]Guan Y, Chen W, Liang X, et al. Easy matting:a stroke based approach for continuous image matting[C].Proc of Eurogrphics.2006:567-576.
    [64]. Boykov Y., Kolmogorov V. An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. Trans. PAMI (2004) 1124-1137.
    [65]Jianbo Shi, Jitendra Malik. Normalized cuts and image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence,22(8):888-905,2000.
    [66]Mikhail S. Improvement of Bayesian Matting[C]. Proc of the International Conference on Computer Graphics and Vision. Moscow, Russia:[s. n.],2007.
    [67]A.Santella and D.DeCarlo. Visual interest and NPR:an evaluation and manifesto. In NPAR'04, pp.71-150,2004.
    [68]J.Fischer, M.Haller, and B.Thomas. Stylized Depiction in Mixed Reality. International Journal of Virtual Reality,2009.
    [69]J.Chen,S.Paris,and F.Durand.Real-Time Edge-Aware Image Processing with the Bilateral Grid.In Proceedings of the ACM SIGGRAPH,2007,pp.171-182.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700