彩色图像灰度化算法综述
|
摘要
针对2005年之后的多种主流灰度化方法进行研究,根据是否对所有像素使用相同映射函数将其分为全局映射法、局部映射法及混合法,介绍每类方法所包含的典型算法的基本思想、实现步骤及优缺点。最后用定性和定量两种评价方法对各种主要算法的实验结果和性能进行对比分析,进一步提出存在的问题及下一步研究方向,为今后的彩色图像灰度化研究提供参考和借鉴。
This paper provided a thorough review of the state-of-art methods of decolorization after 2005,dividing them into global mapping methods,local mapping methods and hybrid methods according to whether all pixels using the same mapping function. The basic idea,implementation steps,strengths and limitations of typical algorithms of each type were introduced afterwards. Finally,after analyzing the qualitative and quantitative evaluation of given methods,this paper proposed the existing problems and next research direction,which provided constructive reference for the further research of decolorization.
This paper provided a thorough review of the state-of-art methods of decolorization after 2005,dividing them into global mapping methods,local mapping methods and hybrid methods according to whether all pixels using the same mapping function. The basic idea,implementation steps,strengths and limitations of typical algorithms of each type were introduced afterwards. Finally,after analyzing the qualitative and quantitative evaluation of given methods,this paper proposed the existing problems and next research direction,which provided constructive reference for the further research of decolorization.
引文
[1]冈萨雷斯·C·拉斐尔,伍兹·E·理查德.数字图像处理[M].阮秋琦,阮宇智,等译.3版.北京:电子工业出版社,2011:26-29.(Gonzalez R C,Woods R E.Digital image processing[M].Ruan Qiuqi,Ruan Yuzhi,et al.Translated.3rd ed.Beijing:Publishing House of Electronics Industry,2011:19-26.)
[2]宋凤菲.彩色图像灰度化及其效果的客观评价方法研究[D].厦门:华侨大学,2014.(Song Fengfei.Color images to grayscale conversions and its objective evaluation method research[D].Xiamen:Huaqiao University,2014.)
[3]Cadík M.Perceptual evaluation of color-to-grayscale image conversions[J].Computer Graphics Forum,2010,27(7):1745-1754.
[4]Benedetti L,Corsini M,Cignoni P,et al.Color to gray conversions in the context of stereo matching algorithms:an analysis and comparison of current methods and an Ad hoc theoretically-motivated technique for image matching[J].Machine Vision&Applications,2012,23(2):327-348.
[5]Robert L D.Review paper:the Helmholtz-Kohlrausch effect[J].Journal of the Society for Information Display,2011,19(10):658-664.
[6]Nayatani Y.Simple estimation methods for the Helmholtz-Kohlrausch effect[J].Color Research&Application,1997,22(6):385-401.
[7]Nayatani Y.Relations between the two kinds of representation methods in the Helmholtz-Kohlrausch effect[J].Color Research&Application,1998,23(5):288-301.
[8]Fairchild M D,Pirrotta E.Predicting the lightness of chromatic object colors using CIELAB[J].Color Research&Application,1991,16(6):385-393.
[9]Cui Ming,Hu Jiuxiang,Razdan A,et al.Color-to-gray conversion using ISOMAP[J].International Journal of Computer Graphics,2010,26(11):1349-1360.
[10]周茗琪.基于显著度的图像灰度化算法研究[D].上海:上海交通大学,2015.(Zhou Mingqi.Saliency based decolorization[D].Shanghai:Shanghai Jiao Tong University,2015.)
[11]Gooch A A,Olsen S C,Tumblin J,et al.Color2gray:salience-preserving color removal[J].ACM Trans on Graphics,2005,24(3):634-639.
[12]Tanaka G,Suetake N,Uchino E.Derivation of the analytical solution of color2gray algorithm and its application to fast color removal based on color quantization[J].Optical Review,2009,16(6):601-612.
[13]章卫祥,周秉锋.一种基于梯度域的彩色图像转灰度图像的方法[J].影像技术,2007(3):20-22.(Zhang Weixiang,Zhou Bingfeng.A color to gray method based on gradient domain[J].Image Technology,2007(3):20-22.)
[14]Rasche K.Re-coloring Images for Gamuts of lower dimension[J].Computer Graphics Forum,2005,24(3):423-432.
[15]Kuk J G,Ahn J H,Cho N I.A color to grayscale conversion considering local and global contrast[C]//Proc of Asian Conference on Computer Vision.Berlin:Springer,2010:513-524.
[16]Grundland M,Dodgson N A.Decolorize:fast,contrast enhancing,color to grayscale conversion[J].Pattern Recognition,2007,40(11):2891-2896.
[17]Archambeau C,Delannay N,Verleysen M.Mixtures of robust probabilistic principal component analyzers[J].Neurocomputing,2008,71(7-9):1274-1282.
[18]Seo J W,Kim S D.Novel PCA-based color-to-gray image conversion[C]//Proc of IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2013:2279-2283.
[19]Kim Y,Jang C,Demouth J,et al.Robust color-to-gray via nonlinear global mapping[J].TOG,2009,28(5):article No.161.
[20]朱薇,刘利刚.IHLS颜色空间的灰度化全局非线性三向映射[J].计算机辅助设计与图形学学报,2013,25(2):154-159.(Zhu Wei,Liu Ligang.Decolorize nonlinear tri-mapping in IHLScolor space[J].Journal of Computer-Aided Design and Computer Graphics,2013,25(2):154-159.)
[21]Song Mingli,Tao Dacheng,Chen Chun,et al.Color to gray:visual cue preservation[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2010,32(9):1537-1552.
[22]Song Mingli,Tao Dacheng,Chen Chun,et al.Color-to-gray based on chance of happening preservation[J].Neurocomputing,2013,119(16):222-231.
[23]Lu Cewu,Xu Li,Jia Jiaya.Contrast preserving decolorization[C]//Proc of IEEE International Conference on Computational Photography.Piscataway,NJ:IEEE Press,2012:1-7.
[24]Lu Cewu,Xu Li,Jia Jiaya.Real-time contrast preserving decolorization[C]//Proc of SIGGRAPH Asia Technical Briefs.New York:ACM Press,2012.
[25]Lu Cewu,Xu Li,Jia Jiaya.Contrast preserving decolorization with perception-based quality metrics[J].International Journal of Computer Vision,2014,110(2):222-239.
[26]Liu Qiegen,Liu P X,Wang Yuhao,et al.Semiparametric decolorization with Laplacian-based perceptual quality metric[J].IEEETrans on Circuits&Systems for Video Technology,2017,27(9):1856-1868.
[27]Zhou Mingqi,Sheng Bing,Ma Lizhuang.Saliency preserving decolorization[C]//Proc of IEEE International Conference on Multimedia and Expo.Piscataway,NJ:IEEE Press,2014:1-6.
[28]Chen Jie,Li Xin,Zhu Xiuchang,et al.Visual perception preserving decolorization method[J].International Journal of Signal Processing,Image Processing and Pattern Recognition,2016,9(7):65-78.
[29]Nafchi H Z,Shahkolaei A,Hedjam R,et al.Corr C2G:color to gray conversion by correlation[J].IEEE Signal Processing Letters,2017,24(11):1651-1655.
[30]Song Yibing,Bao Linchao,Xu Xiaobin,et al.Decolorization:is rgb2gray out?[C]//Proc of SIGGRAPH Asia Technical Briefs.New York:ACM Press,2013:1-4.
[31]Bala R,Eschbach R.Spatial color-to-grayscale transform preserving chrominance edge information[C]//Proc of Color and Imaging Conference.2004:82-86.
[32]Neumann L,Nemcsics A.An efficient perception-based adaptive color to gray transformation[C]//Proc of Eurographics Conference on Computational Aesthetics in Graphics,Visualization and Imaging.Nicosia,Cyprus:Eurographics Association,2007:73-80.
[33]Smith K,Landes P,Thollot J,et al.Apparent greyscale:a simple and fast conversion to perceptually accurate images and video[J].Computer Graphics Forum,2010,27(2):193-200.
[34]Ancuti C O,Ancuti C,Bekaert P.Decolorizing images for robust matching[C]//Proc of IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2010:149-152.
[35]Ancuti C O,Ancuti C,Bekaert P.Enhancing by saliency-guided decolorization[C]//Proc of IEEE Conference on Computer Vision and Pattern Recognition.Washington DC:IEEE Computer Society,2011:257-264.
[36]Zhu Wei,Hu Ruizhen,Liu Liang.Grey conversion via perceivedcontrast[M].Berlin:Springer,2014:299-309.
[37]卢红阳,刘且根,熊娇娇,等.基于最大加权投影求解的彩色图像灰度化对比度保留算法[J].自动化学报,2017,43(5):843-854.(Lu Hongyang,Liu Qiegen,Xiong Jiaojiao,et al.Maximum weighted projection solver for contrast preserving decolorization[J].Acta Automatica Sinica,2017,43(5):843-854.)
[38]罗婷婷.两种改进的彩色图像灰度化算法研究[D].杭州:浙江工商大学,2014.(Luo Tingting.Research on two improved decolorization algorithms[D].Hangzhou:Zhejiang Gongshang University,2014.)
[39]Hsin Chengho,Le H N,Shin S J.Color to grayscale transform preserving natural order of hues[C]//Proc of International Conference on Electrical Engineering and Informatics.Piscataway,NJ:IEEEPress,2011:1-6.
[40]Wu Jingliang,Shen Xiaoyong,Liu Liang.Interactive two-scale colorto-gray[J].Visual Computer,2012,28(6-8):723-731.
[41]Du Hao,He Shengfeng,Sheng Bin,et al.Saliency-guided color-togray conversion using region-based optimization[J].IEEE Trans on Image Processing,2015,24(1):434-443.
[42]Ancuti C,Ancuti C O.Laplacian-guided image decolorization[C]//Proc of IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2016:4107-4111.
[43]Ma Kede,Zhao Tiesong,Zeng Kai,et al.Objective quality assessment for color-to-gray image conversion[J].IEEE Trans on Image Processing,2015,24(12):4673-4685.
[44]Zhao Ye,Tamimi Z.Spectral image decolorization[M]//Advances in Visual Computing.Berlin:Springer,2010:747-756.
[45]De Queiroz R L,Braun K M.Color to gray and back:color embedding into textured gray images[J].IEEE Trans on Image Processing,2006,15(6):1464-1470.
[46]Naser A M.Color to grayscale image conversion based dimensionality reduction with stationary wavelet transform[C]//Proc of AL-SADEQInternational Conference on Multidisciplinary in It and Communication Science and Applications.Piscataway,NJ:IEEE Press,2016:1-5.
[47]肖剑雄峰,赵汉理,吴承文.局部对比度增强的彩色图像灰度化参数化算法[J].计算机时代,2016(3):45-49.(Xiao Jianxiongfeng,Zhao Hanli,Wu Chengwen.Image decolorization and parameterization algorithm with local contrast enhancement[J].Computer Era,2016(3):45-49.)
[2]宋凤菲.彩色图像灰度化及其效果的客观评价方法研究[D].厦门:华侨大学,2014.(Song Fengfei.Color images to grayscale conversions and its objective evaluation method research[D].Xiamen:Huaqiao University,2014.)
[3]Cadík M.Perceptual evaluation of color-to-grayscale image conversions[J].Computer Graphics Forum,2010,27(7):1745-1754.
[4]Benedetti L,Corsini M,Cignoni P,et al.Color to gray conversions in the context of stereo matching algorithms:an analysis and comparison of current methods and an Ad hoc theoretically-motivated technique for image matching[J].Machine Vision&Applications,2012,23(2):327-348.
[5]Robert L D.Review paper:the Helmholtz-Kohlrausch effect[J].Journal of the Society for Information Display,2011,19(10):658-664.
[6]Nayatani Y.Simple estimation methods for the Helmholtz-Kohlrausch effect[J].Color Research&Application,1997,22(6):385-401.
[7]Nayatani Y.Relations between the two kinds of representation methods in the Helmholtz-Kohlrausch effect[J].Color Research&Application,1998,23(5):288-301.
[8]Fairchild M D,Pirrotta E.Predicting the lightness of chromatic object colors using CIELAB[J].Color Research&Application,1991,16(6):385-393.
[9]Cui Ming,Hu Jiuxiang,Razdan A,et al.Color-to-gray conversion using ISOMAP[J].International Journal of Computer Graphics,2010,26(11):1349-1360.
[10]周茗琪.基于显著度的图像灰度化算法研究[D].上海:上海交通大学,2015.(Zhou Mingqi.Saliency based decolorization[D].Shanghai:Shanghai Jiao Tong University,2015.)
[11]Gooch A A,Olsen S C,Tumblin J,et al.Color2gray:salience-preserving color removal[J].ACM Trans on Graphics,2005,24(3):634-639.
[12]Tanaka G,Suetake N,Uchino E.Derivation of the analytical solution of color2gray algorithm and its application to fast color removal based on color quantization[J].Optical Review,2009,16(6):601-612.
[13]章卫祥,周秉锋.一种基于梯度域的彩色图像转灰度图像的方法[J].影像技术,2007(3):20-22.(Zhang Weixiang,Zhou Bingfeng.A color to gray method based on gradient domain[J].Image Technology,2007(3):20-22.)
[14]Rasche K.Re-coloring Images for Gamuts of lower dimension[J].Computer Graphics Forum,2005,24(3):423-432.
[15]Kuk J G,Ahn J H,Cho N I.A color to grayscale conversion considering local and global contrast[C]//Proc of Asian Conference on Computer Vision.Berlin:Springer,2010:513-524.
[16]Grundland M,Dodgson N A.Decolorize:fast,contrast enhancing,color to grayscale conversion[J].Pattern Recognition,2007,40(11):2891-2896.
[17]Archambeau C,Delannay N,Verleysen M.Mixtures of robust probabilistic principal component analyzers[J].Neurocomputing,2008,71(7-9):1274-1282.
[18]Seo J W,Kim S D.Novel PCA-based color-to-gray image conversion[C]//Proc of IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2013:2279-2283.
[19]Kim Y,Jang C,Demouth J,et al.Robust color-to-gray via nonlinear global mapping[J].TOG,2009,28(5):article No.161.
[20]朱薇,刘利刚.IHLS颜色空间的灰度化全局非线性三向映射[J].计算机辅助设计与图形学学报,2013,25(2):154-159.(Zhu Wei,Liu Ligang.Decolorize nonlinear tri-mapping in IHLScolor space[J].Journal of Computer-Aided Design and Computer Graphics,2013,25(2):154-159.)
[21]Song Mingli,Tao Dacheng,Chen Chun,et al.Color to gray:visual cue preservation[J].IEEE Trans on Pattern Analysis and Machine Intelligence,2010,32(9):1537-1552.
[22]Song Mingli,Tao Dacheng,Chen Chun,et al.Color-to-gray based on chance of happening preservation[J].Neurocomputing,2013,119(16):222-231.
[23]Lu Cewu,Xu Li,Jia Jiaya.Contrast preserving decolorization[C]//Proc of IEEE International Conference on Computational Photography.Piscataway,NJ:IEEE Press,2012:1-7.
[24]Lu Cewu,Xu Li,Jia Jiaya.Real-time contrast preserving decolorization[C]//Proc of SIGGRAPH Asia Technical Briefs.New York:ACM Press,2012.
[25]Lu Cewu,Xu Li,Jia Jiaya.Contrast preserving decolorization with perception-based quality metrics[J].International Journal of Computer Vision,2014,110(2):222-239.
[26]Liu Qiegen,Liu P X,Wang Yuhao,et al.Semiparametric decolorization with Laplacian-based perceptual quality metric[J].IEEETrans on Circuits&Systems for Video Technology,2017,27(9):1856-1868.
[27]Zhou Mingqi,Sheng Bing,Ma Lizhuang.Saliency preserving decolorization[C]//Proc of IEEE International Conference on Multimedia and Expo.Piscataway,NJ:IEEE Press,2014:1-6.
[28]Chen Jie,Li Xin,Zhu Xiuchang,et al.Visual perception preserving decolorization method[J].International Journal of Signal Processing,Image Processing and Pattern Recognition,2016,9(7):65-78.
[29]Nafchi H Z,Shahkolaei A,Hedjam R,et al.Corr C2G:color to gray conversion by correlation[J].IEEE Signal Processing Letters,2017,24(11):1651-1655.
[30]Song Yibing,Bao Linchao,Xu Xiaobin,et al.Decolorization:is rgb2gray out?[C]//Proc of SIGGRAPH Asia Technical Briefs.New York:ACM Press,2013:1-4.
[31]Bala R,Eschbach R.Spatial color-to-grayscale transform preserving chrominance edge information[C]//Proc of Color and Imaging Conference.2004:82-86.
[32]Neumann L,Nemcsics A.An efficient perception-based adaptive color to gray transformation[C]//Proc of Eurographics Conference on Computational Aesthetics in Graphics,Visualization and Imaging.Nicosia,Cyprus:Eurographics Association,2007:73-80.
[33]Smith K,Landes P,Thollot J,et al.Apparent greyscale:a simple and fast conversion to perceptually accurate images and video[J].Computer Graphics Forum,2010,27(2):193-200.
[34]Ancuti C O,Ancuti C,Bekaert P.Decolorizing images for robust matching[C]//Proc of IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2010:149-152.
[35]Ancuti C O,Ancuti C,Bekaert P.Enhancing by saliency-guided decolorization[C]//Proc of IEEE Conference on Computer Vision and Pattern Recognition.Washington DC:IEEE Computer Society,2011:257-264.
[36]Zhu Wei,Hu Ruizhen,Liu Liang.Grey conversion via perceivedcontrast[M].Berlin:Springer,2014:299-309.
[37]卢红阳,刘且根,熊娇娇,等.基于最大加权投影求解的彩色图像灰度化对比度保留算法[J].自动化学报,2017,43(5):843-854.(Lu Hongyang,Liu Qiegen,Xiong Jiaojiao,et al.Maximum weighted projection solver for contrast preserving decolorization[J].Acta Automatica Sinica,2017,43(5):843-854.)
[38]罗婷婷.两种改进的彩色图像灰度化算法研究[D].杭州:浙江工商大学,2014.(Luo Tingting.Research on two improved decolorization algorithms[D].Hangzhou:Zhejiang Gongshang University,2014.)
[39]Hsin Chengho,Le H N,Shin S J.Color to grayscale transform preserving natural order of hues[C]//Proc of International Conference on Electrical Engineering and Informatics.Piscataway,NJ:IEEEPress,2011:1-6.
[40]Wu Jingliang,Shen Xiaoyong,Liu Liang.Interactive two-scale colorto-gray[J].Visual Computer,2012,28(6-8):723-731.
[41]Du Hao,He Shengfeng,Sheng Bin,et al.Saliency-guided color-togray conversion using region-based optimization[J].IEEE Trans on Image Processing,2015,24(1):434-443.
[42]Ancuti C,Ancuti C O.Laplacian-guided image decolorization[C]//Proc of IEEE International Conference on Image Processing.Piscataway,NJ:IEEE Press,2016:4107-4111.
[43]Ma Kede,Zhao Tiesong,Zeng Kai,et al.Objective quality assessment for color-to-gray image conversion[J].IEEE Trans on Image Processing,2015,24(12):4673-4685.
[44]Zhao Ye,Tamimi Z.Spectral image decolorization[M]//Advances in Visual Computing.Berlin:Springer,2010:747-756.
[45]De Queiroz R L,Braun K M.Color to gray and back:color embedding into textured gray images[J].IEEE Trans on Image Processing,2006,15(6):1464-1470.
[46]Naser A M.Color to grayscale image conversion based dimensionality reduction with stationary wavelet transform[C]//Proc of AL-SADEQInternational Conference on Multidisciplinary in It and Communication Science and Applications.Piscataway,NJ:IEEE Press,2016:1-5.
[47]肖剑雄峰,赵汉理,吴承文.局部对比度增强的彩色图像灰度化参数化算法[J].计算机时代,2016(3):45-49.(Xiao Jianxiongfeng,Zhao Hanli,Wu Chengwen.Image decolorization and parameterization algorithm with local contrast enhancement[J].Computer Era,2016(3):45-49.)