Content-Aware Image Retargeting Using Line-Based MLS Deformation

详细信息    查看全文

• 关键词：Image retargeting ; MLS deformation ; Saliency ; Animation
• 刊名：Lecture Notes in Computer Science
• 出版年：2017
• 出版时间：2017
• 年：2017
• 卷：10092
• 期：1
• 页码：215-230
• 参考文献：1.Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized scale-and-stretch for image resizing. ACM Trans. Graph. 27(5), 118:1–118:8 (2008)CrossRef
  2.Silveira, C.L.B., de Oliveira Mierlo, F., Luiz Gonzaga, J., da Costa, C.A., Farias, K., da Rosa Righi, R.: Faster seam carving with minimum energy windows. In: Proceedings of the 29th Annual ACM Symposium on Applied Computing, pp. 45–48 (2014)
  3.Kiess, J., Gritzner, D., Guthier, B., Kopf, S., Effelsberg, W.: GPU video retargeting with parallelized seamcrop. In: Proceedings of the 5th ACM Multimedia Systems Conference, pp. 139–147 (2014)
  4.Schaefer, S., McPhail, T., Warren, J.: Image deformation using moving least squares. ACM Trans. Graph. 25(3), 533–540 (2006). Special issue of ACM SIGGRAPH 2006CrossRef
  5.Ma, J., Zhao, J., Tian, J.: Nonrigid image deformation using moving regularized least squares. IEEE Signal Process. Lett. 20(10), 988–991 (2013)CrossRef
  6.Zhang, Y., Lai, J., Du, X.: Vision-related MLS image deformation using saliency map. In: 6th International Conference on Image and Graphics (ICIG), pp. 193–198, August 2011
  7.Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRef
  8.Harel, J., Koch, C., Perona, P.: Graph-based visual saliency. In: Proceedings of Neural Information Processing Systems (NIPS), pp. 545–552 (2006)
  9.Duan, L., Wu, C., Miao, J., Qing, L., Fu, Y.: Visual saliency detection by spatially weighted dissimilarity. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 473–480, June 2011
  10.Krahenbuhl, P., Lang, M., Hornung, A., Gross, M.: A system for retargeting of streaming video. ACM Transactions on Graphics: Proceedings of ACM SIGGRAPH Asia 28(5) (2009)
  11.Carroll, R., Agarwala, A., Agrawala, M.: Image warps for artistic perspective manipulation. ACM Trans. Graph. 29(4), 127:1–127:9 (2010). Special Issue of ACM SIGGRAPH 2010CrossRef
  12.Mitra, N.J., Wand, M., Zhang, H., Cohen-Or, D., Kim, V., Huang, Q.X.: Structure-aware shape processing. In: ACM SIGGRAPH Courses (2014)
  13.Gal, R., Sorkine, O., Cohen-Or, D.: Feature-aware texturing. In: Proceedings of Eurographics Symposium on Rendering, pp. 297–303 (2006)
  14.Shamir, A., Avidan, S.: Seam carving for media retargeting. Commun. ACM 52(1), 77–85 (2009)CrossRef
  
• 作者单位：Xuekuo Li (17)
  Yong Zhang (18)
  Xiaorong Du (17)
  
  17. School of Physics, Sun Yat-Sen University, Guangzhou, China
  18. School of Information Science and Technology, Sun Yat-Sen University, Guangzhou, China
  
• 丛书名：Transactions on Edutainment XIII
• ISBN：978-3-662-54395-5
• 卷排序：10092

文摘

Content-aware image retargeting, also known as seam carving or content aware scaling, is an algorithm for image resizing developed in recent years. In this paper, we present a content-aware image retargeting method by combining the line-based Moving Least Squares (MLS) deformation and saliency map. We develop a salience-related weight of MLS deformation that allows manually defining regions in which pixels may not be moved. Therefore, the new image retargeting can change non-vital parts of the image while preserving local shapes in the areas with high saliency. Benefited from the line-based MLS deformation, our method can retarget image from rectangle to arbitrary polygon. When the constrained lines are at the interior of the boundary of image, our method can also deal with the artistic perspective manipulation problem well. The purpose of developing this algorithm is to display images without distortion on various media in the field of industrial, entertainment or artistic creation. Experimental results show that the proposed method outperforms existing methods in terms of visual performance.