3D-HEVC深度图像帧内编码单元划分快速算法
|
摘要
针对3维高性能视频编码(3D-HEVC)中深度图像帧内编码单元(Coding Unit,CU)划分复杂度高的问题,该文提出一种基于角点和彩色图像的自适应快速CU划分算法。首先利用角点算子,并根据量化参数选取一定数目的角点,以此进行CU的预划分;然后联合彩色图像的CU划分对预划分的CU深度级进行调整;最后依据调整后的CU深度级,缩小当前CU的深度级范围。实验结果表明,与原始3D-HEVC的算法相比,该文所提算法平均减少了约63%的编码时间;与只基于彩色图像的算法相比,该文的算法减少了约13%的编码时间,同时降低了约3%的平均比特率,有效地提高了编码效率。
An efficient Coding Unit(CU) decision algorithm is proposed for depth intra coding, in which the depth level of CU is predicted by Corner-Point(CP) and the co-located texture CU. More specially, firstly, the CPs are obtained by corner detector in junction with the quantization parameter, which are further used to pre-allocate the depth level. After that, the refinement of pre-allocation depth level is performed by considering the block partition of the co-located texture. Finally, different depth search range is selected based on the final pre-allocation depth levels. Simulation results show that the proposed algorithm can provide about 63% time saving with maintaining coding performance compared with the original 3D-HEVC method. On the other hand, it can achieve about 13% time saving while the BD-rate 3% decreased over the CU decision method that only considers the texture information.
An efficient Coding Unit(CU) decision algorithm is proposed for depth intra coding, in which the depth level of CU is predicted by Corner-Point(CP) and the co-located texture CU. More specially, firstly, the CPs are obtained by corner detector in junction with the quantization parameter, which are further used to pre-allocate the depth level. After that, the refinement of pre-allocation depth level is performed by considering the block partition of the co-located texture. Finally, different depth search range is selected based on the final pre-allocation depth levels. Simulation results show that the proposed algorithm can provide about 63% time saving with maintaining coding performance compared with the original 3D-HEVC method. On the other hand, it can achieve about 13% time saving while the BD-rate 3% decreased over the CU decision method that only considers the texture information.
引文
[1]ISO&IEC and MPEG.Information technology-MPEG video technologies-Part 3:Representation of auxiliary video and supplemental information[R].ISO/IEC/JTC1/SC29-23002-3,2007.
[2]张秋闻,安平,张艳,等.基于虚拟视点绘制失真估计的深度图帧内编码[J].电子与信息学报,2011,33(11):2541-2546.doi:10.3724/SP.J.1146.2011.00218.ZHANG Qiuwen,AN Ping,ZHANG Yan,et al.Depth map intra moding based on virtual view rendering distortion estimation[J].Journal of Electronics&Information Technology,2011,33(11):2541-2546.doi:10.3724/SP.J.1146.2011.00218.
[3]时琳,刘荣科,李君烨.基于深度信息的立体视频错误隐藏方法[J].电子与信息学报,2012,34(4):1678-1684.doi:10.3724/SP.J.1146.2011.01107.SHI Lin,LIU Rongke,and LI Junye.Error concealment based on depth information for stereoscopic video coding[J].Journal of Electronics&Information Technology,2012,34(4):1678-1684.doi:10.3724/SP.J.1146.2011.01107.
[4]MULLER K,SCHWARZ H,MARPE D,et al.3Dhigh-efficiency video coding for multi-view video and depth data[J].IEEE Transactions on Image Processing,2013,22(9):3366-3378.doi:10.1109/TIP.2013.2264820.
[5]SULLIVAN G J,OHM J R,HAN W J,et al.Overview of the High Efficiency Video Coding(HEVC)standard[J].IEEETransactions on Circuits and Systems for Video Technology,2012,22(12):1649-1668.doi:10.1109/TCSVT.2012.2221191.
[6]MERKLE P,MULLER K,ZHAO X,et al.Simplified Wedgelet search for DMM modes 1 and 3--JCT3V-B0039[R].ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11,2012.
[7]GU Z Y,ZHENG J H,LING N,et al.Fast depth modeling mode selection for 3D HEVC depth intra coding[C].IEEEInternational Conference on Multimedia&Expo Workshops,San Jose,CA,2013:1-4.doi:10.1109/ICMEW.2013.6618267.
[8]PARK C.Edge-based intra mode selection for depth-map coding in 3D-HEVC[J].IEEE Transactions on Image Processing,2015,24(1):155-162.doi:10.1109/TIP.2014.2375653.
[9]李元,何小海,钟国韵,等.一种基于时域相关性的高性能视频编码快速帧间预测单元模式判决算法[J].电子与信息学报,2013,35(10):2364-2370.doi:10.3724/SP.J.1146.2013.00028.LI Yuan,HE Xiaohai,ZHONG Guoyun,et al.A fast inter-frame prediction unit mode decision algorithm for high efficiency video coding based on temporal correlation[J].Journal of Electronics&Information Technology,2013,35(10):2364-2370.doi:10.3724/SP.J.1146.2013.00028.
[10]齐美彬,陈秀丽,杨艳芳,等.高效率视频编码帧内预测编码单元划分快速算法[J].电子与信息学报,2014,36(7):1699-1705.doi:10.3724/SP.J.1146.2013.01148.QI Meibin,CHEN Xiuli,YANG Yanfang,et al.Fast coding unit splitting algorithm for high efficiency video coding intra prediction[J].Journal of Electronics&Information Technology,2014,36(7):1699-1705.doi:10.3724/SP.J.1146.2013.01148.
[11]SHEN Liquan,ZHANG Zhaoyang,and LIU Zhi.Effective CU size decision for HEVC intra coding[J].IEEETransactions on Image Processing,2014,23(10):4232-4241.doi:10.1109/TIP.2014.2341927.
[12]SHEN Liquan,ZHANG Zhaoyang,and AN Ping.Fast CUsize decision and mode decision algorithm for HEVC intra coding[J].IEEE Transactions on Consumer Electronics,2013,59(1):207-213.doi:10.1109/TCE.2013.6490261.
[13]MIOK K,NAM L,and LI S.Fast single depth intra mode decision for depth map coding in 3D-HEVC[C].IEEEInternational Conference on Multimedia&Expo Workshops,Turin,Italy,2015:1-6.doi:10.1109/ICMEW.2015.7169769.
[14]MORE E G,JUNG J,CAGNAZZO M,et al.Initialization,limitation,and predictive coding of the depth and texture quadtree in 3D-HEVC[J].IEEE Transactions on Circuits and Systems for Video Technology,2014,24(9):1554-1565.doi:10.1109/TCSVT.2013.2283110.
[15]LI W and LU Y.Rate-distortion optimization for depth map coding with distortion estimation of synthesized view[C].IEEE International Symposium on Circuits and Systems,Beijing,China,2013:17-20.doi:10.1109/ISCAS.2013.6571771.
[16]ROSTEN E and DRUMMOND T.Fusing points and lines for high performance tracking[C].IEEE International Conference on Computer Vision,Beijing,China,2005:1508-1515.doi:10.1109/ICCV.2005.104.
[17]SHI J and TOMASI C.Good features to track[C].IEEEInternational Conference on Computer Vision and Pattern Recognition,Seattle,WA,1994:593-600.doi:10.1109/CVPR.1994.323794.
[18]HARRIS C and STEPHENS M.A combined corner and edge detector[C].Alvey Vision Conference,Manchester,UK,1988:147-151.
[19]MPEG 3D-HTM Software V13.0[OL].https://hevc.hhi.fraunhofer.de/svn/svn 3DVCSoftware/tags/13.0,2014.
[20]BJPMTEGAARD G.Calculation of average PSNRdifferences between RD curves[R].ITU-T Video Coding Experts Group,2002.
[21]MERKLE P,SMOLIC K,MULLER P,et al.Efficient prediction structures for Multi-view video coding[J].IEEETransactions on Circuits and Systems for Video Technology,2007,17(11):1461-1473.doi:10.1109/TCSVT.2007.903665.
[2]张秋闻,安平,张艳,等.基于虚拟视点绘制失真估计的深度图帧内编码[J].电子与信息学报,2011,33(11):2541-2546.doi:10.3724/SP.J.1146.2011.00218.ZHANG Qiuwen,AN Ping,ZHANG Yan,et al.Depth map intra moding based on virtual view rendering distortion estimation[J].Journal of Electronics&Information Technology,2011,33(11):2541-2546.doi:10.3724/SP.J.1146.2011.00218.
[3]时琳,刘荣科,李君烨.基于深度信息的立体视频错误隐藏方法[J].电子与信息学报,2012,34(4):1678-1684.doi:10.3724/SP.J.1146.2011.01107.SHI Lin,LIU Rongke,and LI Junye.Error concealment based on depth information for stereoscopic video coding[J].Journal of Electronics&Information Technology,2012,34(4):1678-1684.doi:10.3724/SP.J.1146.2011.01107.
[4]MULLER K,SCHWARZ H,MARPE D,et al.3Dhigh-efficiency video coding for multi-view video and depth data[J].IEEE Transactions on Image Processing,2013,22(9):3366-3378.doi:10.1109/TIP.2013.2264820.
[5]SULLIVAN G J,OHM J R,HAN W J,et al.Overview of the High Efficiency Video Coding(HEVC)standard[J].IEEETransactions on Circuits and Systems for Video Technology,2012,22(12):1649-1668.doi:10.1109/TCSVT.2012.2221191.
[6]MERKLE P,MULLER K,ZHAO X,et al.Simplified Wedgelet search for DMM modes 1 and 3--JCT3V-B0039[R].ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11,2012.
[7]GU Z Y,ZHENG J H,LING N,et al.Fast depth modeling mode selection for 3D HEVC depth intra coding[C].IEEEInternational Conference on Multimedia&Expo Workshops,San Jose,CA,2013:1-4.doi:10.1109/ICMEW.2013.6618267.
[8]PARK C.Edge-based intra mode selection for depth-map coding in 3D-HEVC[J].IEEE Transactions on Image Processing,2015,24(1):155-162.doi:10.1109/TIP.2014.2375653.
[9]李元,何小海,钟国韵,等.一种基于时域相关性的高性能视频编码快速帧间预测单元模式判决算法[J].电子与信息学报,2013,35(10):2364-2370.doi:10.3724/SP.J.1146.2013.00028.LI Yuan,HE Xiaohai,ZHONG Guoyun,et al.A fast inter-frame prediction unit mode decision algorithm for high efficiency video coding based on temporal correlation[J].Journal of Electronics&Information Technology,2013,35(10):2364-2370.doi:10.3724/SP.J.1146.2013.00028.
[10]齐美彬,陈秀丽,杨艳芳,等.高效率视频编码帧内预测编码单元划分快速算法[J].电子与信息学报,2014,36(7):1699-1705.doi:10.3724/SP.J.1146.2013.01148.QI Meibin,CHEN Xiuli,YANG Yanfang,et al.Fast coding unit splitting algorithm for high efficiency video coding intra prediction[J].Journal of Electronics&Information Technology,2014,36(7):1699-1705.doi:10.3724/SP.J.1146.2013.01148.
[11]SHEN Liquan,ZHANG Zhaoyang,and LIU Zhi.Effective CU size decision for HEVC intra coding[J].IEEETransactions on Image Processing,2014,23(10):4232-4241.doi:10.1109/TIP.2014.2341927.
[12]SHEN Liquan,ZHANG Zhaoyang,and AN Ping.Fast CUsize decision and mode decision algorithm for HEVC intra coding[J].IEEE Transactions on Consumer Electronics,2013,59(1):207-213.doi:10.1109/TCE.2013.6490261.
[13]MIOK K,NAM L,and LI S.Fast single depth intra mode decision for depth map coding in 3D-HEVC[C].IEEEInternational Conference on Multimedia&Expo Workshops,Turin,Italy,2015:1-6.doi:10.1109/ICMEW.2015.7169769.
[14]MORE E G,JUNG J,CAGNAZZO M,et al.Initialization,limitation,and predictive coding of the depth and texture quadtree in 3D-HEVC[J].IEEE Transactions on Circuits and Systems for Video Technology,2014,24(9):1554-1565.doi:10.1109/TCSVT.2013.2283110.
[15]LI W and LU Y.Rate-distortion optimization for depth map coding with distortion estimation of synthesized view[C].IEEE International Symposium on Circuits and Systems,Beijing,China,2013:17-20.doi:10.1109/ISCAS.2013.6571771.
[16]ROSTEN E and DRUMMOND T.Fusing points and lines for high performance tracking[C].IEEE International Conference on Computer Vision,Beijing,China,2005:1508-1515.doi:10.1109/ICCV.2005.104.
[17]SHI J and TOMASI C.Good features to track[C].IEEEInternational Conference on Computer Vision and Pattern Recognition,Seattle,WA,1994:593-600.doi:10.1109/CVPR.1994.323794.
[18]HARRIS C and STEPHENS M.A combined corner and edge detector[C].Alvey Vision Conference,Manchester,UK,1988:147-151.
[19]MPEG 3D-HTM Software V13.0[OL].https://hevc.hhi.fraunhofer.de/svn/svn 3DVCSoftware/tags/13.0,2014.
[20]BJPMTEGAARD G.Calculation of average PSNRdifferences between RD curves[R].ITU-T Video Coding Experts Group,2002.
[21]MERKLE P,SMOLIC K,MULLER P,et al.Efficient prediction structures for Multi-view video coding[J].IEEETransactions on Circuits and Systems for Video Technology,2007,17(11):1461-1473.doi:10.1109/TCSVT.2007.903665.