结合时空梯度感知特征的HEVC-SCC码率控制算法
|
摘要
针对屏幕内容视频具有大量文字、图形区域以及锐利边缘的特点,本文在HEVC-SCC编码标准上提出一种结合时空梯度感知特征的HEVC-SCC码率控制算法。考虑把有效的码率用在对于人眼视觉系统更加敏感的特性上,本算法主要从空域和时域两方面进行屏幕内容视频感知特性的提取。在空域方面,采用差分算子提取梯度幅值信息,得到空域特征的描述子;在时域方面,采用可以较好描述屏幕内容视频感知特征的梯度相似性度量信息,结合相邻帧间的相关性,得到时域特征的描述子。将时空梯度感知特性进行融合,用以控制屏幕内容视频编码的码率。实验结果表明,在随机接入模式下,本算法和原始HEVC-SCC算法相比,在略微降低误码率、节省码率开销的同时提高了视频的感知质量。
Based on the large number of texts, graphics areas and sharp edges characteristics in screen content video, a rate control algorithm for HEVC-SCC with perceptual features of spatial and temporal gradient is proposed in this paper. Considering that effective bitrates should be used to the features that are more sensitive for human visual system, the perceptual features are extracted from spatial and temporal domains. In spatial domain, a difference operator is used to extract the gradient magnitude information and obtain the descriptor of spatial features. In temporal domain, gradient similarity measure information is used, which can better describe the perceptual features of screen content video. Combining the correlation between adjacent frames, the descriptor of time domain features is obtained. The fusion of these features is used to guide the rate control of HEVC-SCC. Experimental results show that, in random access mode, compared with the original HEVC-SCC, the perceptual qualities of videos are improved with the reduction of bitrate error.
Based on the large number of texts, graphics areas and sharp edges characteristics in screen content video, a rate control algorithm for HEVC-SCC with perceptual features of spatial and temporal gradient is proposed in this paper. Considering that effective bitrates should be used to the features that are more sensitive for human visual system, the perceptual features are extracted from spatial and temporal domains. In spatial domain, a difference operator is used to extract the gradient magnitude information and obtain the descriptor of spatial features. In temporal domain, gradient similarity measure information is used, which can better describe the perceptual features of screen content video. Combining the correlation between adjacent frames, the descriptor of time domain features is obtained. The fusion of these features is used to guide the rate control of HEVC-SCC. Experimental results show that, in random access mode, compared with the original HEVC-SCC, the perceptual qualities of videos are improved with the reduction of bitrate error.
引文
[1] Yu H,McCann K,Cohen R,et al.Requirement for an extension of HEVC for coding of screen content.Document MPEG2014/N12174,Jan.2014.
[2] Liu S,Xu X,Lei S,et al.Overview of HEVC extensions on screen content coding[J].APSIPA Transactions on Signal and Information Processing,2015,4.
[3] Xu J,Joshi R,Cohen R.Overview of the emerging HEVC screen content coding extension[J].IEEE Transactions on Circuits & Systems for Video Technology,2016,26(1):50- 62.
[4] Pang C,Sole J,Guo L,et al.Non-RCE3:Intra motion compensation with 2-D MVs.Document JCTVC-N0256,Jul.2013.
[5] Chen J,Chen Y,Hsieh T,et al.Description of screen content coding technology proposal by Qualcomm.Document JCTVC-Q0031,Apr.2014.
[6] Pu W,Karczewicz M,Joshi R,et al.Palette mode coding in HEVC screen content coding extension[J].IEEE Journal on Emerging and Selected Topics in Circuits and Systems,2016,6(4):420- 432.
[7] Zhang L,Xiu X,Chen J,et al.Adaptive Color-Space transform in HEVC screen content coding[J].IEEE Journal on Emerging & Selected Topics in Circuits & Systems,2016,6(4):446- 459.
[8] Marpe D,Kirchhoffer H,George V,et al.Macroblock-Adaptive residual color space transforms for 4:4:4 video coding[C]//IEEE International Conference on Image Processing.IEEE,2006:3157-3160.
[9] Li B,Xu J,Sullivan G,et al.Adaptive motion vector resolution for screen content.19th JCT-VC meeting,Strasbourg,France,document JCTVC-S0085,Oct.2014.
[10] Song F,Zhu C,Liu Y,et al.A new GOP level bit allocation method for HEVC rate control[C]//IEEE International Symposium on Broadband Multimedia Systems & Broadcasting.IEEE,2017:1- 4.
[11] Guo H,Zhu C,Li S,et al.Optimal bit allocation at frame level for rate control in HEVC[J].IEEE Transactions on Broadcasting,2018:1-12.
[12] Li B,Zhou M,Zhang Y,et al.Model parameters estimation for CTU level rate control in HEVC[J].IEEE MultiMedia,2018:1-1.
[13] Guo Y,Li B,Sun S,et al.Rate control for screen content coding in HEVC[C]//IEEE International Symposium on Circuits and Systems.IEEE,2015:1118-1121.
[14] Wang C,Li J,Wang S,et al.A frame level rate control algorithm for screen content coding[C]//IEEE International Symposium on Circuits and Systems.IEEE,2018:1- 4.
[15] Xiao J,Li B,Sun S,et al.Rate control with delay constraint for screen content coding[C]//IEEE International Conference on Image Processing.IEEE,2017:10-13.
[16] Yang A,Zeng H,Chen J,et al.Perceptual feature guided rate distortion optimization for high efficiency video coding[J].Multidimensional Systems and Signal Processing,2016:1-18.
[17] Li B,Li H,Li L,et al.(l) Domain rate control algorithm for high efficiency video coding[J].IEEE Transactions on Image Processing,2014,23(9):3841-3854.
[18] Ni Z,Ma L,Zeng H,et al.Gradient direction for screen content image quality assessment[J].IEEE Signal Processing Letters,2016,23(10):1394-1398.
[19] Wang Z,Bovik A,Sheikh H,et al.Image Quality Assessment:From Error Visibility to Structural Similarity[J].IEEE Transactions on Image Processing,2004,13(4):600- 612.
[20] Yu H,Cohen R,Rapaka K,et al.Common conditions for screen content coding tests.Document JCTVC-Q1015,Valencia,ES,Apr.2014.
[2] Liu S,Xu X,Lei S,et al.Overview of HEVC extensions on screen content coding[J].APSIPA Transactions on Signal and Information Processing,2015,4.
[3] Xu J,Joshi R,Cohen R.Overview of the emerging HEVC screen content coding extension[J].IEEE Transactions on Circuits & Systems for Video Technology,2016,26(1):50- 62.
[4] Pang C,Sole J,Guo L,et al.Non-RCE3:Intra motion compensation with 2-D MVs.Document JCTVC-N0256,Jul.2013.
[5] Chen J,Chen Y,Hsieh T,et al.Description of screen content coding technology proposal by Qualcomm.Document JCTVC-Q0031,Apr.2014.
[6] Pu W,Karczewicz M,Joshi R,et al.Palette mode coding in HEVC screen content coding extension[J].IEEE Journal on Emerging and Selected Topics in Circuits and Systems,2016,6(4):420- 432.
[7] Zhang L,Xiu X,Chen J,et al.Adaptive Color-Space transform in HEVC screen content coding[J].IEEE Journal on Emerging & Selected Topics in Circuits & Systems,2016,6(4):446- 459.
[8] Marpe D,Kirchhoffer H,George V,et al.Macroblock-Adaptive residual color space transforms for 4:4:4 video coding[C]//IEEE International Conference on Image Processing.IEEE,2006:3157-3160.
[9] Li B,Xu J,Sullivan G,et al.Adaptive motion vector resolution for screen content.19th JCT-VC meeting,Strasbourg,France,document JCTVC-S0085,Oct.2014.
[10] Song F,Zhu C,Liu Y,et al.A new GOP level bit allocation method for HEVC rate control[C]//IEEE International Symposium on Broadband Multimedia Systems & Broadcasting.IEEE,2017:1- 4.
[11] Guo H,Zhu C,Li S,et al.Optimal bit allocation at frame level for rate control in HEVC[J].IEEE Transactions on Broadcasting,2018:1-12.
[12] Li B,Zhou M,Zhang Y,et al.Model parameters estimation for CTU level rate control in HEVC[J].IEEE MultiMedia,2018:1-1.
[13] Guo Y,Li B,Sun S,et al.Rate control for screen content coding in HEVC[C]//IEEE International Symposium on Circuits and Systems.IEEE,2015:1118-1121.
[14] Wang C,Li J,Wang S,et al.A frame level rate control algorithm for screen content coding[C]//IEEE International Symposium on Circuits and Systems.IEEE,2018:1- 4.
[15] Xiao J,Li B,Sun S,et al.Rate control with delay constraint for screen content coding[C]//IEEE International Conference on Image Processing.IEEE,2017:10-13.
[16] Yang A,Zeng H,Chen J,et al.Perceptual feature guided rate distortion optimization for high efficiency video coding[J].Multidimensional Systems and Signal Processing,2016:1-18.
[17] Li B,Li H,Li L,et al.(l) Domain rate control algorithm for high efficiency video coding[J].IEEE Transactions on Image Processing,2014,23(9):3841-3854.
[18] Ni Z,Ma L,Zeng H,et al.Gradient direction for screen content image quality assessment[J].IEEE Signal Processing Letters,2016,23(10):1394-1398.
[19] Wang Z,Bovik A,Sheikh H,et al.Image Quality Assessment:From Error Visibility to Structural Similarity[J].IEEE Transactions on Image Processing,2004,13(4):600- 612.
[20] Yu H,Cohen R,Rapaka K,et al.Common conditions for screen content coding tests.Document JCTVC-Q1015,Valencia,ES,Apr.2014.