计算机视觉中的光照色度估计研究
详细信息    本馆镜像全文|  推荐本文 |  |   获取CNKI官网全文
摘要
光照的变化会引起图像和视频中物体表面颜色、阴影的变化,这对一些计算机视觉的相关应用可能会产生不利的影响,比如图像分割、物体识别、目标追踪等。因此从图像和视频中估计出场景的光照色度,并基于此将场景中的光照变化影响消除,是非常有意义的研究方向。针对这一内容,论文主要开展了以下三个方面的工作:
     当前的光照色度估计算法,可分为无监督的算法和有监督的算法两大类。在无监督算法中,基于高阶导数图像结构的Gray Edge算法,比基于原始图像结构的其他算法具有更好的光照色度估计准确率。而在有监督的算法中,基于支持向量回归(Support Vector Regression, SVR)的算法能够得到最好的光照色度估计结果,但是在原始的SVR的算法中,仅仅利用了原始图像结构信息,因此在本论文中提出了一种基于支持向量回归的高阶导数图像光照色度估计算法,并且为了克服当前使用的高斯滤波做为图像预处理的缺点,新算法将双边滤波结合进来,进一步提高了算法的光照估计准确率。最后通过实验,证明了算法的有效性。
     目前的光照色度估计算法大多是针对静态图像的,对视频上的光照色度估计研究却相对较少。当前对视频进行光照色度估计主要是通过将视频分解为帧,对每帧独立地估计该帧的光照,我们把这种方法称为基于帧的视频光照色度估计算法。但是视频的帧与帧之间是有高度相关性的,所以我们提出了一种基于同光照场景分割的视频光照色度估计算法,它能够充分利用帧间的关联信息来估计光照色度。算法的主要思想是将视频的帧分割为不同的场景,这里假设同一场景中的帧图像都是在同一种光照下,所以称之为同光照场景,然后从这些帧图像的组合中估计出同光照场景的光照色度,最后基于此修改每帧的光照色度估计值。
     光照色度估计算法可以分为单光照场景和多光照场景两种情况,我们对多光照场景中的一种特殊情况——阴影进行了研究。阴影是一种多光照突变,阴影区域和非阴影区域具有完全不同的光照。阴影去除是将阴影区域中像素点的颜色,恢复到非阴影区域光照的效果下,因此,阴影去除的过程实际上就是多光照色度估计和校正的过程。本文提出了一种基于区域光照色度估计的图像阴影去除算法。算法的主要思路是通过光照色度估计算法对非阴影区和阴影区分别进行光照色度估计,然后计算变换阴影区中像素点到非阴影区光照效果下的比率因子,进而根据该比率因子对阴影区中的像素点进行光照变换,从而达到阴影去除的效果。
Illumination changing will cause object's surface color changing and shadow in images and video clips. This will lead incorrect results for many computer vision tasks, such as image segmentation, object recognition, target tracking and so on. So illumination color estimation and adjusting is an important research area. This dissertation focuses on illumination chromaticity estimation problem in computer vision. Our work is carried out from the following three aspects.
     At present, illumination chromaticity estimation algorithms could be divided into two classes, unsupervised methods and supervised methods. Among unsupervised methods, Gray Edge using higher-order image structure performs better than the other algorithms using zero-order image structure. SVR-based illumination estimation algorithm produces the best results among supervised methods. So in this dissertation, we proposed a new illumination chromaticity estimation algorithm which combines Gray Edge and SVR together. This algorithm is proved to be able to improve accuracy of illumination chromaticity estimation.
     Almost all of the illumination chromaticity estimation algorithms are designed for still images. Although they could be used on video clips frame by frame, the relative information between frames is abandoned. So an illumination chromaticity estimation algorithm especially for videos is proposed. This method takes advantages of the similarities of illuminations and contents between adjacent frames. Experiments showed that using the proposed method generate better illumination chromaticity estimation results on video clips than the other methods.
     Shadow is a kind of multi-illumination situation. Illumination in shadow region is totally different with the illumination in non-shadow region. So shadow removal process is a multi-illumination chromaticity estimation and adjusting process. A shadow removal algorithm based on regional illumination chromaticity estimation is proposed here. Pixel values in shadow region are transformed to what they should appear under non-shadow illumination. Experiments on synthetic images and real images proved the proposed algorithm is effective.
引文
[1]阮秋琦.数字图像处理学.第一版.北京.电子工业出版社.2001.48-62
    [2]David A. Forsyth and Jean Ponce.林学訚.王宏.计算机视觉——一种现代方法.第一版.北京.电子工业出版社.2004.83-112
    [3]M. Livingstone. Art, illusion and the visual system. Science America.1988,258(1):78-85.
    [4]I. Rock Perception. Scientific American Books.1983:111-112
    [5]K. Barnard, V. Cardei, B. V. Funt. A comparison of computational color constancy algorithms-part I:Methodology and experiments with synthesized data. IEEE trans. on Image Processing.2002,11(9):972-983.
    [6]K. Barnard, L. Martin, A. Coath, B. V. Funt. A comparison of computational color constancy algorithms-part II:Experiments with Image Data. IEEE Transactions on Image Processing. 2002,11(9):985-996.
    [7]A. Gijsenij, Th. Gevers and J. van de Weijer. Computational Color Constancy:Survey and Experiments. IEEE Transactions on Image Processing.2011,20 (9):2475-2489.
    [8]B. Li, W. Xiong, W. Hu, O.Wu. Evaluating combinational color constancy methods on real-world images. In:CVPR:IEEE,2011, S.1929-1936
    [9]J. von Kries. Chromatic adaptation. Sources of Color Science.1970:12-13
    [10]W. Xiong. Separating Illumination from Reflectance in Color Imagery. [PhD Dissertation] Simon Fraser University,2007:30-67
    [11]Ebner M. Color Constancy. John Wiley & Sons.2007
    [12]李兵.颜色恒常性计算研究.北京交通大学,博士论文.2009
    [13]鹿瑞.自然图像的颜色恒常性计算研究.北京交通大学,博士论文.2011
    [14]Brian Funt, Kobus Barnard, Lindsay Martin. Is colour constancy good enough. In:Proc. of 5th European Conference on Computer Vision (ECCV),1998:445-459.
    [15]Land, E. H. The retinex theory of color vision. Scientific American,1977,237(6):108-128.
    [16]G. Buchsbaum. A spatial processor model for object colour perception. Journal of the Franklin Institute,1980,310(1):337-350.
    [17]G D. Finlayson, E. Trezzi. Shades of gray and colour constancy. In:Proceeding of IS&T/SID 12th Color Imaging Conference (CIC),2004:37-41.
    [18]J. V. Weijer, T. Gevers, A. Gijsenij. Edge-Based Color Constancy. IEEE Trans. on Image Processing,2007,16(9):2207-2214.
    [19]A. Gijsenij, Th. Gevers. Color Constancy using Image Regions. In:Proc. of IEEE International Conference on Image Processing (ICIP'07) San Antonio, Texas,2007: 501-504.
    [20]A. Gijsenij, Th. Gevers. Color Constancy by Local Averaging. In:Proc. Of Computational Color Imaging Workshop (CCIW'07), in conjunction with ICIAP Modena,2007:171-174.
    [21]Lu Rui, De Xu, et al. Color Constancy using Effective Regions. IEICE Trans. On Inf.& Sys.,2008,91(7):2091-2094.
    [22]A. Gijsenij, Th. Gevers, J. van de Weijer. Edge Classification for Color Constancy. In:Proc. of IS&T's European Conference on Colour in Graphics, Imaging and Vision (CGIV'08) Terrassa, Spain,2008:9-13.
    [23]A. Gijsenij, Th. Gevers and J. van de Weijer. Improving Color Constancy by Photometric Edge Weighting. IEEE Transactions on Pattern Analysis and Machine Intelligence, Accepted, 2011.
    [24]B. Li, D. Xu, W. Xiong, and S. Feng. Color constancy using achromatic surface. Color Research and Application,2010, vol.35, no.4, pp.304-312
    [25]W. Xiong, Funt B., Shi L. Automatic white balancing via Grey Surface Identification. In: Proceeding of IS&T/SID Color Imaging Conference (CIC),2007:5-9.
    [26]D. H. BRAINARD, W. T. FREEMAN. Bayesian color constancy. Journal of the Optical Society of America A,1997,14(7):1393-1411.
    [27]C. Rosenberg, T. Minka, A. Ladsariya. Bayesian Color Constancy with Non-Gaussian Models. In:Proc. Of Neural Information Processing Systems Conference (NIPS),2003.
    [28]Peter V. Gehler, Carsten Rother, Andrew Blake, Toby Sharp and Tom Minka. Bayesian Color Constancy Revisited. In:Proc. Of IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR),2008:1-8.
    [29]D. A. Forsyth. A novel algorithm for color constancy. International Journal of Computer Vision.1990,5(1):5-36.
    [30]A. Gijsenij, T. Gevers, and J. van de Weijer. Generalized gamut mapping using image derivative structures for color constancy. International Journal of Computer Vision, vol.86, no.12, pp.127-139,2010.
    [31]M. Mosny and B. Funt. Cubical gamut mapping colour constancy. IS\&T's European Conference on Color in Graphics, Imaging and Vision,2010.
    [32]G. Finlayson, S. Hordley, P. Hubel. Color by correlation:A simple, unifying framework for color constancy. IEEE Trans. Pattern Anal. Machine Intell.,2001,23(11):1209-1221.
    [33]V. Cardei, B. Funt, K. Barnard, Estimating the Scene Illumination Chromaticity Using a Neural Network. Journal of the Optical Society of America A,2002,19(12):2374-2386.
    [34]W. Xiong, B. Funt. Estimating Illumination Chromaticity via Support Vector Regression. Journal of Imaging Science and Technology,2006,50(4):341-348.
    [35]C. Rosenberg, M. Hebert, S. Thrun, Color constancy using KL-divergence. Proc. of IEEE International Conference on Computer Vision.2001:239-246.
    [36]W. Xiong, L. Shi, B. Funt. Illumination Estimation via Thin-Plate Spline Interpolation. Proc. Of IS&T/SID Color Imaging Conference.2007:25-29.
    [37]G Sapiro. Color and Illuminant Voting. IEEE Transactions on Pattern Analysis and Machine Intelligence.1999,21(11):1210-1215.
    [38]A. Gijsenij and Th. Gevers. Color Constancy using Natural Image Statistics and Scene Semantics. IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 33 (4), page 687-698,2011.
    [39]A. Chakrabarti, K. Hirakawa and T. Zickler. Color Constancy with Spatio-spectral Statistics. IEEE Transactions on Pattern Analysis and Machine Intelligence, Accepted,2011 (Preprint).
    [40]S. Bianco, G Ciocca, C. Cusano, and R. Schettini. Automatic color constancy algorithm selection and combination. Pattern Recognition, vol.43, no.3, pp.695-705,2010.
    [41]J. van de Weijer, C. Schmid, and J.J. Verbeek. Using high-level visual information for color constancy. IEEE International Conference on Computer Vision.2007:1-8.
    [42]S. Bianco, G. Ciocca, C. Cusano, and R. Schettini. Improving color constancy using indoor-outdoor image classification. IEEE Transactions on Image Processing.2008,17(12): 2381-2392.
    [43]E. Land, J. McCann. Lightness and Retinex Theory. Journal of the Optical Society of America A,1971,61(1):1-11.
    [44]Jr. T.G. Stockham. Image processing in the context of a visual model. Proc. of IEEE,1972, 60(7):828-842
    [45]O.D. Faugeras. Digital image color processing within the framework of a human visual system. IEEE transactions on ASSP,1979,27():380-393.
    [46]B.K.P. Horn. Determining lightness from an image. Computer Graphics and Image Processing,1974,3(4):277-299.
    [47]Weihua Xiong, Brian Funt. Stereo Retinex. Image and Vision Computing,2009, 27(1):178-188.
    [48]Rahman Z., Jobson, D.J., G.A. Woodell. Multi-scale retinex for color image enhancement. In:Proc. IEEE Int. Conf. on Image Processing(ICIP),1996:1003-1006.
    [49]D.J. Jobson, Z. Rahman, G.A. Woodell. A multiscale retinex for bridging the gap between color images andthe human observation of scenes. IEEE Trans. On Image Processing,1997, 6(7):965-976.
    [50]Zia-ur Rahman, Daniel J. Jobson, Glenn A. Woodell. Retinex processing for automatic image enhancement. J. Electron. Imaging,2004,13(1):100-110.
    [51]Marc Ebner. Color Constancy Using Local Color Shifts. In:Proc. Of the 8th European Conference on Computer Vision (ECCV),2004:276-287.
    [52]Marc Ebner. Combining White-Patch Retinex and the Gray World Assumption to Achieve Color Constancy for Multiple Illuminants. In:Proc. of the 25th DAGM Symposium, Magdeburg, Germany,2003:60-67.
    [53]M. Ebner. Estimating the Color of the Illuminant using Anisotopic Diffusion. In Proc. of the 12th International Conference on Computer Analysis of Images and Patterns,2007: 441-449.
    [54]G.D. Finlayson, B.V. Funt, K. Barnard. Color Constancy Under Varying Illumination. In: Proc. Of Int. Conf. on Computer Vision (ICCV),1995:720-725.
    [55]A. Gijsenij, R. Lui and Th. Gevers. Color Constancy for Multiple Light Sources. IEEE Transactions on Image Processing, Accepted,2011.
    [56]G.. D. Finlayson, S. D. Hordley, C. Lu, and M. S. Drew. On the Removal of Shadows from Images. IEEE Trans on PAMI.2006.28(1).59-68
    [57]A. Prati, I. Mikic, R. Cucchiara and M. M. Trivedi. Comparative Evaluation of Moving Shadow Detection Algorithms. Workshop on Empirical Evaluation Methods in Computer Vision.2001
    [58]D. Koller, K. Daniilidis, and H. H. Nagel. Model-based Object Tracking in Monocular Image Sequences of Road Traffic Scenes. International Journal of Computer Vision.1993. 10(3).257-281
    [59]C. Fredembach and G. D. Finlayson. Hamiltonian Path Based Shadow Removal. British Machine Vision Conference.2005
    [60]C. Fredembach and G. D. Finlayson. Simple Shadow Removal. International Conference on Pattern Recognition.2006.832-835
    [61]E. Arbel and H. Hel Or. Texture-Preserving Shadow Removal in Color Images Containing Curved Surfaces. Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.2007.1-8
    [62]E. Arbel and H. Hel-Or. Shadow Removal Using Intensity Surfaces and Texture Anchor Points. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.33, no.6, pp. 1202-1216,(2011).
    [63]http://gvi.seas.harvard.edu/
    [64]http://color.psych.upenn.edu/brainard/index.html
    [65]http://www.cs.cmu.edu/-chuck/color/research/
    [66]http://luthuli.cs.uiuc.edu/-daf/
    [67]http://vision.cs.arizona.edu/kobus/
    [68]http://www.cs.sfu.ca/%7Ecolour/
    [69]http://www.science.uva.nl/research/isla/
    [70]http://www2.cmp.uea.ac.uk/Research/compvis/colour.htm
    [71]http://www.kyb.mpg.de/publication.html?publ=5098
    [72]http://www.math-inf.uni-greifswald.de/mathe/index.php/mitarbeiter/608-prof-marc-ebner
    [73]http://www.cvl.iis.u-tokyo.ac.jp/index.html
    [74]陶霖密.计算机视觉系统的二步法颜色恒常性.清华大学学报.2000,40(7):101-104.
    [75]陶霖密,徐光祐.机器视觉中的颜色问题及应用.科学通报.2001,46(3):178-190.
    [76]陶霖密.机器颜色视觉及人类肤色特征.清华大学.博士论文.2001.
    [77]X. Yuan, S. Li, R. He. Color constancy via convex kernel optimization. Proc. Of Asian Conference on Computer Vision.2007:728-737.
    [78]http://www.psych.zju.edu.cn/redir.php?catalog_id=869&object_id=966
    [79]蔡殉,孟祥旭,向辉.光照色调颜色恒常性算法研究.中国图像图形学报(A).2004,9(8):922-926.
    [80]蔡殉.视频监控中的背景颜色恒常性算法研究.山东大学.博士论文.2007.
    [81]B. Li, D. Xu, et al. Color Constancy based on Image Similarity. IEICE Transactions On Information and Systems.2008,91(2):375-378.
    [82]B. Li, D. Xu, J. Wang. Color Constancy Based on Image Similarity. IEICE Transactions on Information and Systems.2008, E91-D(2):375-378.
    [83]D. A. Forsyth, Ponce J. Computer Vision:A Modern Approach. Prentice Hall. Inc.2003.
    [84]K. Barnard. Practical Color Constancy [PhD Dissertation]. Simon Fraser University.1999.
    [85]L. Shi. Novel Colour Constancy Algorithms for Digital Color Imagery [PhD Dissertation]. Simon Fraser University.2009.
    [86]B. Funt and L. Shi. The rehabilitation of maxrgb. IS\&T/SID's Color Imaging Conference, 2010.
    [87]B. Funt and L. Shi. The effect of exposure on maxrgb color constancy. Proc. SPIE, vol. 7527 Human Vision and Electronic Imaging XV,2010.
    [88]C. Fredembach and G Finlayson. The bright-chromagenic algorithm for illuminant estimation. in Proc. of the 15th IS&T/SID color imaging conference,2007, pp.137-142.
    [89]Alessandro Rizzi, Carlo Gatta and Daniele Marini. Color correction between gray world and white patch. Proc. SPIE 4662,367 (2002);
    [90]Vivek Agarwal, Andrei V. Gribok, Mongi A. Abidi, Machine learning approach to color constancy, Neural Networks, Volume 20, Issue 5, July 2007, Pages 559-563
    [91]C. Tomasi and R. Manduchi. Bilateral filtering for gray and color images. In Proceedings of the International Conference on Computer Vision, pages 839-846. IEEE,1998.
    [92]E. P. Bennett and L. McMillan. Video enhancement using per-pixel virtual exposures. ACM Transactions on Graphics,24(3):845-852, July 2005. Proceedings of the SIGGRAPH conference.
    [93]C. Liu, W. T. Freeman, R. Szeliski, and S. Kang. Noise estimation from a single image. In Proceedings of the conference on Computer Vision and Pattern Recognition. IEEE,2006.
    [94]B. M. Oh, M. Chen, J. Dorsey, and F. Durand. Image-based modeling and photo editing. In Proceedings of the SIGGRAPH conference. ACM,2001.
    [95]F. Durand and J. Dorsey. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics,21(3),2002. Proceedings of the SIGGRAPH conference.
    [96]M. Elad. Retinex by two bilateral filters. In Proceedings of the Scale-Space conference, 2005.
    [97]R. Ramanath and W. E. Snyder. Adaptive demosaicking. Journal of Electronic Imaging,12 (4):633-642,2003.
    [98]J. Xiao, H. Cheng, H. Sawhney, C. Rao, and M. Isnardi. Bilateral filtering-based optical flow estimation with occlusion detection. In Proceedings of the European Conference on Computer Vision,2006.
    [99]Sylvain Paris, Pierre Komprobst, Jack Tumblin, and Fredo Durand.2008. A gentle introduction to bilateral filtering and its applications. In ACM SIGGRAPH 2008 classes (SIGGRAPH'08). ACM, New York, NY, USA,, Articlel,50 pages.
    [100]Thomas Mitchell. MACHINE LEARNING. McGraw-Hill Education-Europe.1997
    [101]Vladimir N. Vapnik. Statistical Learning Theory. Wiley-Interscience.1 edition.1998
    [102]A. Smola and B. Scholkopf. A tutorial on support vector regression. Statistics and Computing,2003
    [103]Chih-Chung Chang and Chih-Jen Lin, LIBSVM:a library for support vector machines. ACM Transactions on Intelligent Systems and Technology,2:27:1--27:27,2011. Software available at http://www.csie.ntu.edu.tw/-cjlin/libsvm
    [104]S. D. Hordley, G. D. Finlayson. Reevaluation of Color Constancy Algorithm Performance. J. of Opt. Soc. Am. A,2006,23(5):1008-1020.
    [105]K. Barnard, K. Martin, B. Funt and A. Coath. A data set for color research. Color Research and Application, vol.27, pp.147-151, (2002).
    [106]20. F. Ciurea and B. Funt. A large image database for color constancy research. in IS&T/SID's Color Imaging Conference. IS&T-The Society for Imaging Science and Technology, pp.160-164. (2003).
    [107]章毓晋.基于内容的视觉信息检索.科学出版社.第一版.2003.
    [108]Bhattacharyya, A. (1943). On a measure of divergence between two statistical populations defined by their probability distributions. Bulletin of the Calcutta Mathematical Society 35: 99-109.
    [109]Djouadi, A.; Snorrason, O.; Garber, F. (1990). The quality of Training-Sample estimates of the Bhattacharyya coefficient. IEEE Transactions on Pattern Analysis and Machine Intelligence 12(1):92-97.
    [110]Pascal Mamassian, David C. Knill, and Daniel Kersten. The Perception of Cast Shadows. Trends in Cognitive Sciences.1998.2(8).288-295
    [111]http://gandalf.psych.umn.edu/users/kersten/kersten-lab/shadows.html
    [112]M. Bejanin, A. Huertas, G. Medioni, and R. Nevatia. Model Validation for Change Detection. International IEEE Workshop on Applications of Computer Vision.1994.160-167
    [113]C. Jiang and M. O. Ward. Shadow Segmentation and Classification in a Constrained Environment. CVGIP:Image Understanding.1994.59(2).213-225
    [114]E. Salvador, A. Cavallaro, and T. Ebrahimi. Shadow Identification and Classification using Invariant Color Models. ICASSP01.2001.1545-1548
    [115]K. Barnard and G. D. Finlayson. Shadow Identification Using Color Ratios. Proceedings of IS&T/SID 8th Color Imaging Conference.2000.97-101
    [116]M. D. Levine and J. Bhattacharyya. Removing Shadows. Pattern Recognition Letters.2005. 26(3).251-265
    [117]杨俊.基于归一化RGB色彩模型的阴影处理方法.光电工程.2007.34(12).94-96
    [118]A. Gijsenij. Edge-driven Color Constancy. [PhD dissertation]. University of Amsterdam. 2010.
    [119]S.D. Hordley. Scene illumination estimation:past, present, and future. Color Research and Application,2006.31(4):303-314,
    [120]A. Chakrabarti, K. Hirakawa, and T. Zickler. Color constancy beyond bags of pixels. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition,2008: 1-8.

© 2004-2018 中国地质图书馆版权所有 京ICP备05064691号 京公网安备11010802017129号

地址:北京市海淀区学院路29号 邮编:100083

电话:办公室:(+86 10)66554848;文献借阅、咨询服务、科技查新:66554700