基于图像融合的无参考立体图像质量评价
|
摘要
提出了一种基于图像融合的无参考立体图像质量评价算法。该算法利用小波变换分解重构立体图像的左右视图并融合在一幅图像中,归一化处理融合图像的亮度系数,均衡各部分亮度并保留融合图像的结构信息,使用卷积神经网络进行特征提取和回归预测。实验结果表明,所提方法的预测得分与人类主观评价得分具有很好的一致性。
A no-reference stereo image quality assessment algorithm based on image fusion is proposed.The algorithm reconstructs the left and right views of the stereo image by wavelet transform and fuses them into one image.The luminance coefficient of the fused image is normalized,which keeps the brightness of each part in balance and preserves the structural information of the fused image.Finally the convolutional neural network is used to extract feature and predict regression.The experimental results show that the predicted scores of the proposed method are in good agreement with the human subjective assessment scores.
A no-reference stereo image quality assessment algorithm based on image fusion is proposed.The algorithm reconstructs the left and right views of the stereo image by wavelet transform and fuses them into one image.The luminance coefficient of the fused image is normalized,which keeps the brightness of each part in balance and preserves the structural information of the fused image.Finally the convolutional neural network is used to extract feature and predict regression.The experimental results show that the predicted scores of the proposed method are in good agreement with the human subjective assessment scores.
引文
[1]Benoit A,Le Callet P,Campisi P,et al.Quality assessment of stereoscopic images[J].EURASIPJournal on Image and Video Processing,2007,2008(1):1-13.
[2]Chen W T,Lin W C,Shao F.Stereoscopic image quality assessment based on laminar cortical model[J].Journal of Optoelectronics爛Laser,2017,28(5):529-537.陈婉婷,林文崇,邵枫.基于大脑层状皮质模型的立体图像质量评价[J].光电子爛激光,2017,28(5):529-537.
[3]Gao L L,Liu J J,Ren X,et al.Image quality evaluation of panoramic camera steropair based on structural similarity[J].Laser&Optoelectronics Progress,2014,51(7):071004.高露露,刘建军,任鑫,等.基于结构相似度的全景相机立体像对图像质量评价[J].激光与光电子学进展,2014,51(7):071004.
[4]Ma L,Wang X,Liu Q,et al.Reorganized DCT-based image representation for reduced reference stereoscopic image quality assessment[J].Neurocomputing,2016,215:21-31.
[5]Wang X,Liu Q,Wang R,et al.Natural image statistics based 3D reduced reference image quality assessment in contourlet domain[J].Neurocomputing,2015,151:683-691.
[6]Zhou W J,Jiang G Y,Yu M,et al.Reducedreference stereoscopic image quality assessment based on view and disparity zero-watermarks[J].Signal Processing:Image Communication,2014,29(1):167-176.
[7]Xing L Y,You J Y,Ebrahimi T,et al.A perceptual quality metric for stereoscopic crosstalk perception[C]∥IEEE International Conference on Image Processing,2010:4033-4036.
[8]Chen M J,Cormack L K,Bovik A C.No-reference quality assessment of natural stereopairs[J].IEEETransactions on Image Processing,2013,22(9):3379-3391.
[9]Akhter R,Sazzad Z M P,Horita Y,et al.Noreference stereoscopic image quality assessment[J].Proceedings of SPIE,2010,7524:75240T.
[10]Shao F,Lin W S,Gu S B,et al.Perceptual fullreference quality assessment of stereoscopic images by considering binocular visual characteristics[J].IEEETransactions on Image Processing,2013,22(5):1940-1953.
[11]Ryu S,Sohn K.No-reference quality assessment for stereoscopic images based on binocular quality perception[J].IEEE Transactions on Circuits and Systems for Video Technology,2014,24(4):591-602.
[12]Hou C P,Lin H H.Stereoscopic image quality assessment based on wavelet transform and structure characteristics[J].Laser&Optoelectronics Progress,2018,55(6):061005.侯春萍,林洪湖.基于小波变换与结构特征的立体图像质量评价[J].激光与光电子学进展,2018,55(6):061005.
[13]Zhou W J,Yu L,Qiu W W,et al.Utilizing binocular vision to facilitate completely blind 3Dimage quality measurement[J].Signal Processing,2016,129:130-136.
[14]Zhang W,Qu C F,Ma L,et al.Learning structure of stereoscopic image for no-reference quality assessment with convolutional neural network[J].Pattern Recognition,2016,59:176-187.
[15]Appina B,Khan S,Channappayya S S.No-reference stereoscopic image quality assessment using natural scene statistics[J].Signal Processing:Image Communication,2016,43:1-14.
[16]Zhang Y,Jin W Q.Assessment method of fusion image quality in wavelet domain structural similarity[J].Chinese Journal of Lasers,2012,39(s1):s109007.张勇,金伟其.小波域结构相似度融合图像质量评价方法[J].中国激光,2012,39(s1):s109007.
[17]Liu Y,Liu S P,Wang Z F.A general framework for image fusion based on multi-scale transform and sparse representation[J].Information Fusion,2015,24:147-164.
[18]Li S T,Kang X D,Hu J W.Image fusion with guided filtering[J].IEEE Transactions on Image Processing,2013,22(7):2864-2875.
[19]Ruderman D L.The statistics of natural images[J].Network:Computation in Neural Systems,1994,5(4):517-548.
[20]Mittal A,Moorthy A K,Bovik A C.No-reference image quality assessment in the spatial domain[J].IEEE Transactions on Image Processing,2012,21(12):4695-4708.
[21]Chen H,Li C F.Stereoscopic color image quality assessment via deep convolutional neural network[J].Journal of Frontiers of Computer Science and Technology,2018,12(8):1315-1322.陈慧,李朝锋.深度卷积神经网络的立体彩色图像质量评价[J].计算机科学与探索,2018,12(8):1315-1322.
[22]Hu Y,Zhang D B,Ye J P,et al.Fast and accurate matrix completion via truncated nuclear norm regularization[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(9):2117-2130.
[2]Chen W T,Lin W C,Shao F.Stereoscopic image quality assessment based on laminar cortical model[J].Journal of Optoelectronics爛Laser,2017,28(5):529-537.陈婉婷,林文崇,邵枫.基于大脑层状皮质模型的立体图像质量评价[J].光电子爛激光,2017,28(5):529-537.
[3]Gao L L,Liu J J,Ren X,et al.Image quality evaluation of panoramic camera steropair based on structural similarity[J].Laser&Optoelectronics Progress,2014,51(7):071004.高露露,刘建军,任鑫,等.基于结构相似度的全景相机立体像对图像质量评价[J].激光与光电子学进展,2014,51(7):071004.
[4]Ma L,Wang X,Liu Q,et al.Reorganized DCT-based image representation for reduced reference stereoscopic image quality assessment[J].Neurocomputing,2016,215:21-31.
[5]Wang X,Liu Q,Wang R,et al.Natural image statistics based 3D reduced reference image quality assessment in contourlet domain[J].Neurocomputing,2015,151:683-691.
[6]Zhou W J,Jiang G Y,Yu M,et al.Reducedreference stereoscopic image quality assessment based on view and disparity zero-watermarks[J].Signal Processing:Image Communication,2014,29(1):167-176.
[7]Xing L Y,You J Y,Ebrahimi T,et al.A perceptual quality metric for stereoscopic crosstalk perception[C]∥IEEE International Conference on Image Processing,2010:4033-4036.
[8]Chen M J,Cormack L K,Bovik A C.No-reference quality assessment of natural stereopairs[J].IEEETransactions on Image Processing,2013,22(9):3379-3391.
[9]Akhter R,Sazzad Z M P,Horita Y,et al.Noreference stereoscopic image quality assessment[J].Proceedings of SPIE,2010,7524:75240T.
[10]Shao F,Lin W S,Gu S B,et al.Perceptual fullreference quality assessment of stereoscopic images by considering binocular visual characteristics[J].IEEETransactions on Image Processing,2013,22(5):1940-1953.
[11]Ryu S,Sohn K.No-reference quality assessment for stereoscopic images based on binocular quality perception[J].IEEE Transactions on Circuits and Systems for Video Technology,2014,24(4):591-602.
[12]Hou C P,Lin H H.Stereoscopic image quality assessment based on wavelet transform and structure characteristics[J].Laser&Optoelectronics Progress,2018,55(6):061005.侯春萍,林洪湖.基于小波变换与结构特征的立体图像质量评价[J].激光与光电子学进展,2018,55(6):061005.
[13]Zhou W J,Yu L,Qiu W W,et al.Utilizing binocular vision to facilitate completely blind 3Dimage quality measurement[J].Signal Processing,2016,129:130-136.
[14]Zhang W,Qu C F,Ma L,et al.Learning structure of stereoscopic image for no-reference quality assessment with convolutional neural network[J].Pattern Recognition,2016,59:176-187.
[15]Appina B,Khan S,Channappayya S S.No-reference stereoscopic image quality assessment using natural scene statistics[J].Signal Processing:Image Communication,2016,43:1-14.
[16]Zhang Y,Jin W Q.Assessment method of fusion image quality in wavelet domain structural similarity[J].Chinese Journal of Lasers,2012,39(s1):s109007.张勇,金伟其.小波域结构相似度融合图像质量评价方法[J].中国激光,2012,39(s1):s109007.
[17]Liu Y,Liu S P,Wang Z F.A general framework for image fusion based on multi-scale transform and sparse representation[J].Information Fusion,2015,24:147-164.
[18]Li S T,Kang X D,Hu J W.Image fusion with guided filtering[J].IEEE Transactions on Image Processing,2013,22(7):2864-2875.
[19]Ruderman D L.The statistics of natural images[J].Network:Computation in Neural Systems,1994,5(4):517-548.
[20]Mittal A,Moorthy A K,Bovik A C.No-reference image quality assessment in the spatial domain[J].IEEE Transactions on Image Processing,2012,21(12):4695-4708.
[21]Chen H,Li C F.Stereoscopic color image quality assessment via deep convolutional neural network[J].Journal of Frontiers of Computer Science and Technology,2018,12(8):1315-1322.陈慧,李朝锋.深度卷积神经网络的立体彩色图像质量评价[J].计算机科学与探索,2018,12(8):1315-1322.
[22]Hu Y,Zhang D B,Ye J P,et al.Fast and accurate matrix completion via truncated nuclear norm regularization[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(9):2117-2130.