Skin color modeling for face detection and segmentation: a review and a new approach

详细信息    查看全文

• 作者：Wei Chen ; Ke Wang ; Haifeng Jiang ; Ming Li
• 关键词：Image segmentation ; Skin color modeling ; Boundary detection ; Region based segmentation ; Dual hue detector
• 刊名：Multimedia Tools and Applications
• 出版年：2016
• 出版时间：January 2016
• 年：2016
• 卷：75
• 期：2
• 页码：839-862
• 全文大小：1,239 KB
• 参考文献：1.Aghbari ZA, Al-haj R (2006) Hill-manipulation: an effective algorithm for color image segmentation. Image Vis Comput 24:894–903CrossRef
  2.Argyros AA, Lourakis MIA (2004) Real-time tracking of multiple skin-colored objects with a possibly moving camera. Proceedings, European Conference in Computer Vision. 368–379
  3.Baskan S, Bulut MM, Atalay V (2002) Projection based method for segmentation of human face and its evaluation. Pattern Recogn Lett 23:1623–1629CrossRef MATH
  4.Brown D, Craw I, Lewthwaite J (2001) A SOM based approach to skin detection with application in real time systems. Proc. of the British Machine Vision Conference. Citeseer, 491–500
  5.Chai D, Ngan KN (1999) Face segmentation using skin-color map in videophone applications. IEEE Trans Circ Systems Video Technol 9:551–564CrossRef
  6.Chai D, Phung S, Bouzerdoum A (2003) A bayesian skin/non-skin color classifier using non-parametric density estimation. Proc Int Symp Circ Systems 2:464–467
  7.Chen W, Sun TF, Yang XD, Wang L (2009a) Face detection based on half face-template. Proceedings of 9th International Conference on Electronic Measurement and Instruments, 454–458
  8.Chen WC, Wang MS (2007) Region-based and content adaptive skin detection in color images. Int J Pattern Recognit Artif Intell 21:831CrossRef
  9.Chen W et al (2009b) Face location in dim-lightening coal mine surveillance images. Proceedings of the 2nd International Congress on Image and. Signal Process 1:208–211
  10.Chen W et al (2013) Agglomerative clustering using improved rough sets and its applications in cooperative object localization. Comput Electr Eng 39(7):1962–1969CrossRef
  11.Chen W, et al (2014) A new image co-segmentation method using saliency detection for surveillance image of coal miners. Computers & Electrical Engineering, Article
  12.Cho KM, Jang JH, Hong KS (2001) Adaptive skin-color filter. Pattern Recogn 34:1067–1073CrossRef MATH
  13.Do HC, You JY, Chien SI (2007) Skin color detection through estimation and conversion of illuminant color under various illuminations. IEEE Trans Consum Electron 53:1103–1108CrossRef
  14.Duda RO, Hart PE, Stork DG (2001) Pattern classification
  15.Garcia C, Tziritas G (1999) Face detection using quantized skin color regions merging and wavelet packet analysis. IEEE Transactions on Multimedia 1:264–277CrossRef
  16.Gasparini F, Schettini R (2006) Skin segmentation using multiple thresholding. Proc. Internet Imaging VII. 128–135
  17.Gomez G, Sanchez M, Enrique Sucar L (2002a) On selecting an appropriate colour space for skin detection. MICAI 2002: Advances in Artificial Intelligence, Volume 2313, 3–18
  18.Gomez G, Sanchez M, Sucar LE (2002b) On selecting colour components for skin detection. 16th International Conference on Pattern Recognition, 2, 961–964 vol. 2
  19.Gonzalez RC, Woods RE, Eddins SL (2007) Digital Image Processing Using MATLAB, Prentice Hall Press
  20.Han J, Awad G, Sutherland A (2009) Automatic skin segmentation and tracking in sign language recognition. Comput Vis IET 3:24–35CrossRef
  21.Hsu RL, Abdel-Mottaleb M, Jain AK (2002) Face detection in color images. IEEE Trans Pattern Anal Mach Intel 24:696–706CrossRef
  22.Huang YZ, Long YJ (2006) Super-resolution using neural networks based on the optimal recovery theory. J Comput Electron 5(4):275–281CrossRef
  23.Jain AK (1989) Fundamentals of digital image processing. Prentice-Hall, Inc, New YorkMATH
  24.Jones MJ, Rehg JM (2002) Statistical color models with application to skin detection. Int J Comput Vis 46(1):81–96CrossRef MATH
  25.Juang CF, Shiu SJ (2008) Using self-organizing fuzzy network with support vector learning for face detection in color images. Neurocomputing 71:3409–3420CrossRef
  26.Kakumanu P, Makrogiannis S, Bourbakis N (2007) A survey of skin-color modeling and detection methods. Pattern Recogn 40:1106–1122CrossRef MATH
  27.Kawulok M, Kawulok J, Nalepa J (2014) Spatial-based skin detection using discriminative skin-presence features. Pattern Recogn Lett 41:3–13CrossRef
  28.Khan R, Hanbury A, Ttinger JS, BAIS A (2012) Color based skin classification. Pattern Recogn Lett 33(2):157–163CrossRef
  29.Kim M, Park J, Joo Y (2005) New fuzzy skin model for face detection. Adv Artif Intell 3809:557–566MathSciNet
  30.Kim C, You BJ, Jeong MH, KIM H (2008) Color segmentation robust to brightness variations by using B-spline curve modeling. Pattern Recogn 41:22–37CrossRef MATH
  31.Lee JY, Yoo SI (2002) An elliptical boundary model for skin color detection. Proc. of the Int. Conf. on Imaging Science, Systems, and Technology
  32.Li B, Xue X, Fan J (2007) A robust incremental learning framework for accurate skin region segmentation in color images. Pattern Recogn 40:3621–3632CrossRef MATH
  33.Liu Z, Yang J, Peng NS (2005) An efficient face segmentation algorithm based on binary partition tree. Signal Process Image Commun 20:295–314CrossRef
  34.Long YJ, Huang YZ (2006) Image based source camera identification using demosaicking, IEEE 8th Workshop on Multimedia Signal Processing, 419–424
  35.Ma Z, Leijon A (2010) Human skin color detection in RGB space with Bayesian estimation of beta mixture models. Proceedings, European Conference in Computer Vision
  36.Ma YQ, Yu Q, Cohen I (2009) Target tracking with incomplete detection. Comput Vis Image Underst 113(4):580–587CrossRef
  37.Moallem P, Mousavi BS, Monadjemi SA (2010) A novel fuzzy rule base system for pose independent faces detection. Applied Soft Computing, 11
  38.Naji S, Zainuddin R, Jalab HA (2012) Skin segmentation based on multi pixel color clustering models. Digit Signal Process 22:933–940CrossRef
  39.Peer P, Solina F (1999) An automatic human face detection method. Proceedings of Computer Vision Winter Workshop. 122–130
  40.Phung SL, Bouzerdoum A, Chai D (2003) Skin segmentation using color and edge information. IEEE, 525–528 vol. 1
  41.Phung SL, Bouzerdoum A, Chai D (2005) Skin segmentation using color pixel classification: analysis and comparison. IEEE Transactions on Pattern Analysis and Machine Intelligence, 148–154
  42.Phung SL, Chai D, Bouzerdoum A (2001) A universal and robust human skin color model using neural networks. Proceedings of International Joint Conference on Neural Networks. IEEE 4:2844–2849
  43.Pratt WK (2002) Digital image processing: PIKS inside. Recherche 67:02
  44.Russ JC (2007) The image processing handbook. CRC, Boca RatonMATH
  45.Sebe N, Cohen I, Huang TS, Gevers T (2004) Skin detection: A bayesian network approach. Proceedings of the 17th International Conference on Pattern Recognition. IEEE, 903–906
  46.Seow MJ, Valaparla D, Asari VK (2003) Neural network based skin color model for face detection. Proceedings of the 32nd Applied Imagery Pattern Recognition Workshop (AIPR’03). IEEE, 141–145
  47.Shapiro L, Stockman G (2000) Computer Vision
  48.Shih FY, Cheng S, Chuang CF, Wang PSP (2008) Extracting faces and facial features from color images. Int J Pattern Recognit Artif Intell 22:515–534CrossRef
  49.Sigal L, Sclaroff S, Athitsos V (2000) Estimation and prediction of evolving color distributions for skin segmentation under varying illumination. Proceedings IEEE Conference on Computer Vision and Pattern Recognition, 2000. IEEE, 152–159 vol. 2
  50.Sobottka K, Pitas I (1998) A novel method for automatic face segmentation, facial feature extraction and tracking. Signal Process Image Commun 12:263–281CrossRef
  51.Solina F, Peer P, Batagelj B, Juvans S (2002) Fifteen seconds of fame-an interactive, computer-vision based art installation. Control, Automation, Robotics and Vision, 2002. ICARCV 2002. 7th International Conference on. IEEE, 198–204
  52.Soriano M, Martinkauppi B, Huovinen S, Laaksonen M (2000) Skin detection in video under changing illumination conditions. Pattern Recognition 1:839–842
  53.Soriano M, Martinkauppi B, Huovinen S, Laaksonen M (2003) Adaptive skin color modeling using the skin locus for selecting training pixels. Pattern Recogn 36:681–690CrossRef
  54.Storring M (2004) Computer vision and human skin colour. Ph.D., Aalborg University, Denmark
  55.Tan W, Chan C, Yogarajah P, Condell J (2012) A Fusion Approach for Efficient Human Skin Detection. IEEE Transactions on Industrial Informatics, IEEE Transactions on, 1–1
  56.Taqa AY, Jalab H (2010) Increasing the reliability of skin detectors. Sci Res Essays 5:2480–2490
  57.Terrillon JC, Shirazi MN, Fukamachi H, Akamatsu S (2000) Comparative performance of different skin chrominance models and chrominance spaces for the automatic detection of human faces in color images. Fourth IEEE International Conference on Automatic Face and Gesture Recognition, 2000. IEEE, 54–61
  58.Vadakkepat P, Lim P, DE Silva LC, Jing L, Ling LL (2008) Multimodal approach to human-face detection and tracking. IEEE Trans Ind Electron 55:1385–1393CrossRef
  59.Vezhnevets V, Sazonov V, Andreeva A (2003) A survey on pixel-based skin color detection techniques. Graphicon 3
  60.Wang Y, Yuan B (2001) A novel approach for human face detection from color images under complex background. Pattern Recogn 34:1983–1992CrossRef MathSciNet MATH
  61.Wu H, Chen Q, Yachida M (1999) Face detection from color images using a fuzzy pattern matching method. IEEE Trans Pattern Anal Machine Intell 21:557–563CrossRef
  62.Xu T, Wang YH, ZHANG ZX (2013) Pixel-wise skin colour detection based on flexible neural tree. IET Image Process 7(8):751–761CrossRef
  63.Yang MH (2000) Hand gesture recognition and face detection in images. University of Illinois at Urbana-Champaign
  64.Yang MH, Ahuja N (1998) Detecting human faces in color images. IEEE, 127–130 vol. 1
  65.Yang HM, Kriegman DJ, Ahuja N (2002) Detecting faces in images: a survey. IEEE Trans Pattern Anal Mach Intell 24:34–58CrossRef
  66.Yang KF, et al (2013) Efficient Color Boundary Detection with Color-opponent Mechanisms. IEEE Conference on Computer Vision and Pattern Recognition. 2810–2817
  67.Yogarajah P et al (2010) A dynamic threshold approach for skin segmentation in color images. Proceedings, IEEE International Conference on Image Processing. 2225–2228
  68.Zaqout I, Zainuddin R, Baba S (2004) Human face detection in color images. Adv Complex Syst 7:369–383CrossRef
  69.Zarit BD, Super BJ, Quek FKH (1999) Comparison of five color models in skin pixel classification. IEEE, 58–63
  
• 作者单位：Wei Chen (1)
  Ke Wang (1)
  Haifeng Jiang (1)
  Ming Li (1)
  
  1. College of Computer Science and Technology, China University of Mining and Technology, Xuzhou, Jiangsu, 221116, China
  
• 刊物类别：Computer Science
• 刊物主题：Multimedia Information Systems
  Computer Communication Networks
  Data Structures, Cryptology and Information Theory
  Special Purpose and Application-Based Systems
  
• 出版者：Springer Netherlands
• ISSN：1573-7721

文摘

Detecting skin-colored pixels, although seems a straightforward easy task, has proven to be quite a challenging task in images that are captured under complex unconstrained imaging conditions. Color segmentation is an important method of segmenting the body in images. In this paper, we first provides a review of skin color modeling research works for face detection. In particular, we focus on discussing the challenges of skin color modeling, detection, and segmentation, and then we present the skin color modeling and region-based skin segmentation. We also propose a new approach to analyze the hue characteristics of monitoring personnel in coal mine. We determine the skin color boundaries of the miners using the boundary detection method based on the response of visual hue. And then, we apply to determining hue area method using dual hue detector to segment skin color for miners. Experiments show that the method has excellent ability to segment skin regions of miners. We also summarize the most widely used methods for skin detection approaches and collecting their numerical evaluation results. Keywords Image segmentation Skin color modeling Boundary detection Region based segmentation Dual hue detector