View generation with DIBR for 3D display system

详细信息    查看全文

• 作者：Laihua Wang ; Chunping Hou ; Jianjun Lei ; Weiqing Yan
• 关键词：View synthesis ; 3D image warping ; Hole filling ; Depth map
• 刊名：Multimedia Tools and Applications
• 出版年：2015
• 出版时间：November 2015
• 年：2015
• 卷：74
• 期：21
• 页码：9529-9545
• 全文大小：2,440 KB
• 参考文献：1.Cadik M, Herzog R, Mantiuk R (2012) New measurements reveal weaknesses of image quality metrics in evaluating graphics artifacts. ACM Trans Graph 31(6):147:1鈥?47:10CrossRef
  2.Cetin AE, Smolic A (2009) 3DTV: Capture. Transmission, and Display of 3DVideo, eurasip journal on advances in signal processing 2009:1鈥?
  3.Daribo I, Saito H (2011) A novel inpainting-based layered depth video for 3DTV, source. IEEE Trans Broadcast 57(2):533鈥?41CrossRef
  4.De Silva DVSX, Fernando WAC, Nur G, Ekmekcioglu E, Worrall ST (2010) 3D video assessment with just noticeable difference in depth evaluation. Proceedings International Conference on Image Processing, ICIP, Hong Kong, China, pp 4013鈥?016
  5.Do L, Bravo G, Zinger S (2012) GPU-accelerated real-time free-viewpoint DIBR for 3DTV. IEEE Trans Consum Electron 58(2):633鈥?40CrossRef
  6.Hannuksela MM, Rusanovskyy D, Su W, Chen L, Li R, Aflaki P, Lan D, Joachimiak M, Li H, Gabbouj M (2013) Multi-view-video-plus-depth coding based on the advanced video coding standard. IEEE Trans Image Process 22(9):3449鈥?458CrossRef
  7.Heo J, Ho YS (2010) Improved context-based adaptive binary arithmetic coding over H.264/AVC for lossless depth Map coding. IEEE Signal Processing Letters 17(10):835鈥?38CrossRef
  8.Lee DS, Ko MS, Seo YH, Kim DW, Yoo JS (2013) Illumination compensation for multi-view video based on layered histogram matching with depth information. Opt Commun 286(1):74鈥?4CrossRef
  9.Lei J, Feng K, Wu M, Li S, and Hou C (2013), 鈥淩ate control of hierarchical B prediction structure for multi-view video coding,鈥?Multimedia Tools and Applications, DOI: 10.1007/s11042-013-1386-z, pp.1-18
  10.Li S, Lei J, Zhu C, Yu L, Hou C (2014) Pixel-based inter prediction in coded texture assisted depth coding. IEEE Signal Processing Letters 21(1):74鈥?8CrossRef
  11.Liu S, Lai P, Tian D, Chen CW (2011) New depth coding techniques with utilization of corresponding video. IEEE Trans Broadcast 57(2):551鈥?61CrossRef
  12.Mateusz G, Krzysztof W, Marek D (2008) View synthesis software and assessment of its performance, ISO/IEC JTC1/SC29/WG11 MPEG/M15672. Hannover, Germany
  13.McMillan L Jr., (1997), An image-based approach to three-dimensional computer graphics, Ph.D. dissertation, University of North Carolina at Chapel Hill, Chapel Hill, NC
  14.Merkle P, Morvan Y, Smolic A (2009) The effects of multi-view depth video compression on multi-view rendering. signal processing-image communication 24(1鈥?):73鈥?8CrossRef
  15.Mori Y, Fukushima N, Fujii T, Tanimoto M (2008) View generation with 3D warping using depth information for FTV, the true vision - capture transmission and display of 3D video, 3DTV-CON 2008 proceedings. Istanbul, Turkey, pp 229鈥?32CrossRef
  16.M眉ller K, Smolic A, Dix K, Kauff P, Wiegand T (2008) Reliability-based generation and view synthesis in layered depth video, proceedings of the 2008 I.E. 10th workshop on multimedia signal processing, MMSP 2008. Cairns, Australia, pp 34鈥?9
  17.Oh KJ, Yea S, Vetro A, Ho YS (2010) Virtual view synthesis method and self-evaluation metrics for free viewpoint television and 3D video. Int J Imaging Syst Technol 20(4):378鈥?90CrossRef
  18.Smolic A (2011) 3D video and free viewpoint video-From capture to display. Pattern Recogn 44(9):1958鈥?968MathSciNet CrossRef
  19.Solh M, Alregib G (2012) Hierarchical hole-filling for depth-based view synthesis in FTV and 3D video. IEEE Journal on Selected Topics in Signal Processing 6(5):495鈥?04CrossRef
  20.Sundaram M, Ramar K, Arumugam N (2011) Histogram modified local contrast enhancement for mammogram images. applied soft computing 11(8):5809鈥?816CrossRef
  21.Tanimoto M (2012) FTV: free-viewpoint television. signal processing-image communication 27(6):555鈥?70CrossRef
  22.Tauber Z, Li Z, Drew M (2007) Disocclusion by inpainting for image-based rendering. IEEE Trans Syst Man Cybern Part C Appl Rev 37(4):527鈥?40, Review, and previewCrossRef
  23.Wang M, Hu F, Li J (2011) Epipolar resampling of linear pushbroom satellite imagery by a new epipolarity model. isprs journal of photogrammetry and remote sensing 66(3):347鈥?55CrossRef
  24.Yan X, and Luo Y (2011), Action recognition via cumulative histogram of multiple features, Optical Engineering, vol. 50, no.1
  25.Zhao M, Chung R (2010) Critical line-set configurations to epipolar geometry determination and application to image line transfer. Pattern Recogn Lett 31(8):686鈥?95CrossRef
  26.Zinger S, Do L, Peter HN (2012) Recent developments in free-viewpoint interpolation for 3DTV. 3D Research 3(1):1鈥?CrossRef
  
• 作者单位：Laihua Wang (1)
  Chunping Hou (1)
  Jianjun Lei (1)
  Weiqing Yan (1)
  
  1. School of Electronic Information Engineering, Tianjin University, Tianjin, 300072, China
  
• 刊物类别：Computer Science
• 刊物主题：Multimedia Information Systems
  Computer Communication Networks
  Data Structures, Cryptology and Information Theory
  Special Purpose and Application-Based Systems
  
• 出版者：Springer Netherlands
• ISSN：1573-7721

文摘

DIBR is a promising technology for rendering new views of scenes from a collection of densely sampled images or videos. It has potential application in virtual reality, immersive, advanced visualization, and 3D television systems. However, due to imperfect depth maps and the illumination difference between reference images, annoying artifacts appear in the rendering image. To generate high-quality intermediate virtual viewpoint image, this paper proposes a novel virtual view rendering method based on DIBR. The proposed method consists of four main parts: luminance compensation based on histogram matching, isolated depth pixel removing, 3D warping with depth-based pixel interpolation, and background-based hole filling. Experimental results show that our method can obtain high-quality virtual view images and achieve satisfactory subjective visual effects. Keywords View synthesis 3D image warping Hole filling Depth map