结构和特征信息对面部表情识别的影响
|
摘要
面部表情是社交信息的重要来源,但作为面部表情识别的核心问题之一——表情识别的加工机制,还未有一致性结论。目前有三种具有代表性的理论,分别是结构说、特征说和整体说。对人脸图像的空间频率进行滤波,是研究表情识别加工过程的一个有效方法。本研究采用空间频率滤波技术,对表情图片进行高、低通滤波处理,考察不同空间频率对表情识别的影响,并进而探讨结构和特征信息对表情识别的影响。
本研究包括三个实验：实验一在正常、低空间频率和高空间频率三种情境下呈现不同的表情,让被试进行判断,以此考察高、低空间频率对表情识别的影响。实验二在低空间频率、“低空间频率+眼”以及“低空间频率+嘴”三种情境下呈现表情,要求被试进行判断,以此考察结构信息对表情识别的作用。实验三则研究在“低空间频率+眼”、“低空间频率+嘴”以及眼、嘴单独呈现的情境下,让被试判断表情,以此考察特征信息对表情识别的作用。
本研究获得的以下主要结果：
(1)不同表情的识别存在不同的加工机制。对“高兴”和“悲伤”表情的识别,符合“整体说”,而对“愤怒”和“恐惧”表情的识别,却与“特征说”一致。
(2)对表情的识别存在“高兴优势效应”,且这种优势效应是由整体结构引起的。
(3)对低频信息的加工比高频信息更有效。
(4)在识别“高兴”表情时,嘴的作用比较重要,而在识别“愤怒”、“恐惧”和“悲伤”表情时,眼睛的作用则更重要。
总之,本研究结论表明,不同表情的识别存在不同的加工机制,不同的特征信息在不同表情的识别中具有不同的重要性。
Facial expressions are an important source of social information. However, there is not a consistent finding in facial expression processing mechanism which is a key aspect of facial expression recognition area. There are three representative theories, including configural model, featural model and holistic model. Meanwhile, analyzing spatial frequency component is a good way to study facial expression. Therefore, in the present study we study the influence of different spatial frequency on facial expression recognition and explore the impact of configural and featural information on facial expression recognition using high and low spatial frequency pictures.
The present study includes three experiments:Experiment 1 aimed to investigate the influence of spatial frequency on facial expression recognition, in which participants were showed normal, low pass filter and high pass filter pictures, and were required to judge what expression they saw. The second experiment was to explore the impact of configural information on facial expression recognition by using the pictures of low pass filter, low pass filter+eye, low pass filter+mouth. The last experiment was further to study the influence of featural information on facial expression recognition through showing the pictures of low pass filter+eye, low pass filter+mouth, and eye and mouth only.
The main findings of the present study are as below:
(1) Facial expressions differ in processing. The process of happy and sad face is consistent with holistic model; the process of angry and fear face is identical with featural model.
(2) There is "happy face advantage", and this effect is caused by holistic structure.
(3) The processing of low-spatial-frequency information is more effective than the one of high-spatial-frequency information.
(4) Mouth is important for identifying happy face, and eyes are crucial to recognizing anger, fear and sad face.
To sum up, there is different processing mechanism in recognizing facial expressions. The importance of feature information differs in recognizing facial expressions.
本研究包括三个实验：实验一在正常、低空间频率和高空间频率三种情境下呈现不同的表情,让被试进行判断,以此考察高、低空间频率对表情识别的影响。实验二在低空间频率、“低空间频率+眼”以及“低空间频率+嘴”三种情境下呈现表情,要求被试进行判断,以此考察结构信息对表情识别的作用。实验三则研究在“低空间频率+眼”、“低空间频率+嘴”以及眼、嘴单独呈现的情境下,让被试判断表情,以此考察特征信息对表情识别的作用。
本研究获得的以下主要结果：
(1)不同表情的识别存在不同的加工机制。对“高兴”和“悲伤”表情的识别,符合“整体说”,而对“愤怒”和“恐惧”表情的识别,却与“特征说”一致。
(2)对表情的识别存在“高兴优势效应”,且这种优势效应是由整体结构引起的。
(3)对低频信息的加工比高频信息更有效。
(4)在识别“高兴”表情时,嘴的作用比较重要,而在识别“愤怒”、“恐惧”和“悲伤”表情时,眼睛的作用则更重要。
总之,本研究结论表明,不同表情的识别存在不同的加工机制,不同的特征信息在不同表情的识别中具有不同的重要性。
Facial expressions are an important source of social information. However, there is not a consistent finding in facial expression processing mechanism which is a key aspect of facial expression recognition area. There are three representative theories, including configural model, featural model and holistic model. Meanwhile, analyzing spatial frequency component is a good way to study facial expression. Therefore, in the present study we study the influence of different spatial frequency on facial expression recognition and explore the impact of configural and featural information on facial expression recognition using high and low spatial frequency pictures.
The present study includes three experiments:Experiment 1 aimed to investigate the influence of spatial frequency on facial expression recognition, in which participants were showed normal, low pass filter and high pass filter pictures, and were required to judge what expression they saw. The second experiment was to explore the impact of configural information on facial expression recognition by using the pictures of low pass filter, low pass filter+eye, low pass filter+mouth. The last experiment was further to study the influence of featural information on facial expression recognition through showing the pictures of low pass filter+eye, low pass filter+mouth, and eye and mouth only.
The main findings of the present study are as below:
(1) Facial expressions differ in processing. The process of happy and sad face is consistent with holistic model; the process of angry and fear face is identical with featural model.
(2) There is "happy face advantage", and this effect is caused by holistic structure.
(3) The processing of low-spatial-frequency information is more effective than the one of high-spatial-frequency information.
(4) Mouth is important for identifying happy face, and eyes are crucial to recognizing anger, fear and sad face.
To sum up, there is different processing mechanism in recognizing facial expressions. The importance of feature information differs in recognizing facial expressions.
引文
李文.(2007).人脸表情识别方法.电子科技,6,63-68.
元晓旭,姜威.(2007).基于小波能量特征和FLD的人脸表情识别.电子器件,30.1720-1723.
Ambadar, Z., Schooler, J.W.,& Cohn, J.F. (2005). Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychological Science,16,403-410.
Barrera, M. E.,& Maurer, D. (1981). Recognition of mother's photographed face by the three-month-old infant. Child Development,52,714-716.
Bowlby, J. (1969). Attachment and loss:Vol.1. Attachment. New York:Basic Books.
Bruce, V,& Young, A. W. (1986). Understanding face recognition. British Journal of Psychology,77,305-327.
Bruce, V., Doyle, Y, Dench, N.,& Burton, M. (1991). Remembering facial configurations. Cognition,38,109-144.
Calder, A. J., Young, A. W., Keane, J.,& Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology:Human Perception and Performance,26,527-551.
Calder, A. J., Young, A. W., Perrett, D. I., Etcoff, N. L.,& Rowland, D. (1996). Categorical perception of morphed facial expressions. Visual Cognition,3,81-117.
Calder, A. J., Young, A. W., Rowland, D.,& Perrett, D. I. (1997). Computer-enhanced emotion in facial expression. Proceedings of the Royal Society Londeon,264, 919-925.
Campbell, F. W.,& Robson, J. G. (1968). Application of fourier analysis to the visibility of gratings. The Journal of Physiology,197,551-566.
Campbell, R., Brooks, B., de Haan, E.,& Roberts, T. (1996). Dissociating face processing skills:Decisions about lip-read speech, expression and identity. Quarterly Journal of Experimental Psychology,49A,295-314.
Carey, S.,& Diamond, R. (1997).From piecemeal to configuraional representation of faces. Science,195,312-314.
Cooper, E. E.,& Wojan, T. J. (2000). Differences in the coding of spatial relations in face identification and basic-level object recognition. Journal of Experimental Psychology:Learning, Memory and Cognition,26,470-488.
Deruelle C, Fagot J. Categorizing Facial Identities, Emotions, and Gender:Attention to High-and Low-Spatial Frequencies by Children and Adults. Journal of Experimental Child Psychology,90,172-184.
Diamond, R.,& Carey, S. (1986). Why faces are and are not special:An effect of expertise. Journal of Experimental Psychology:General,115,107-117.
Ekman, P.,& Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, California: Consulting Psychologists Press.
Ekman, P., Friesen, W. V.,& Ellsworth, P. (1982). Emotion in the human face. New York:Pergamon.
Ellison, J. W.,& Massaro, D. W. (1997). Featural evaluation, integration, and judgment of facial affect. Journal of Experimental Psychology:Human Perception and Performance,23,213-226.
Endo, M., Kirita, T.,& Abe, T. (1995). The effects of image blurring on the recognition of facial expressions. Tohoku Psyhcological Folia,54,68-82.
Etcoff, N. L.,& Magee, J. J., (1992). Categorical perception of facial expression. Cognition,44,227-240.
Fallshore, M.,& Bartholow, J. (2002). Recognition of emotion from inverted schematic drawings of faces. Perceptual and Motor Skills,96,236-244.
Farah, M. J. (1992). Is an object an object an object? Cognitive and neuropsychological investigation of domain specificity in visual object recognition. Current Directions in Psychological Science,1,164-169.
Farah, M. J., Tanaka, J. W.,& Drain, H. M. (1995). What causes the inversion effect? Journal of Experimental Psychology:Human Perception and Performance,21, 628-634.
Feyereisen, P., Malet, C.,& Martin, Y. (1986).'Is the faster processing modality-specific?'In:H.D. Ellis, M. A. Jeeves, F. Newcombe and A. w. Young (Eds.), Aspects of face processing. Dordrecht:Martinus Nijhoff.
Fiorentini, A., Maffei, L.,& Sandini, G. (1983). The role of high spatial frequencies in face perception. Perception,12,195-201.
Four-and Six-month-old infants'visual responses to joy, anger, and neutral expressions. Child Development,47,535-538.
Garner, W. R. (1978). Aspects of a stimulus:Features, dimensions, and configurations. In E. H. Rosch & B. B. Lloyd(Eds.), Cognition and categorization (pp.99-133). Hillsdale, NJ:Erlbaum.
Goffaux, V., Hault, B., Michel, C., Vuongo, Q. C.,& Rossion, B. (2005). The respective role of low and high spatial frequencies in supporting configural and featural processing of faces. Perception,34,77-86.
Goldstein, E. B. (1996). Sensation and Perception. Pacific Grove, CA:Brooks/Cole.
Goren D, Wilson H R. Quantifying Facial Expression Recognition across Viewing Conditions. Vision Research,46,1253-1262.
Haig, N. D. (1984). The effect of feature displacement on face recognition. Perception, 13,5050-512.
Herrmann, M. J., Aranda, D., Ellgring, H., Mueller, T. J., Strik, W. K., Heidrich, A., et al., (2002). International Journal of Psychophysiology,45,241-244.
Kirouac, G,& Dore, FY., (1983). Accuracy and latency of judgment of facial expressions of emotions. Perception & Motor Skills,57,683-686.
Ladavas, E., Umilta, C.,& Ricci-Bitti, PE.(1980). Evidence for sex differences in right-hemisphere dominance for emotions. Neuropsychologia,18,361-366.
McKelvie, S. (1995). Emotional expression in upside-down faces:Evidence for configurational and componential processing. British Journal of Social Psychology,34,325-334.
Parks, T. E., Coss, R. G,& Coss, C. S. (1985). Thatcher and the Cheshire cat:context and the processing of facial features, Perception,14,747-754.
Prkachin, G. C. (2003). The effects of orientation on detection and identification of facial expressions of emotion. British Journal of Psychology,94,45-62.
Rhodes, G (1988). Looking at faces:First-order and second-order features as determinants of facial appearance. Perception,17,43-63.
Rhodes, G, Brake, S.,& Atkinson, A. (1993). What's lost in inverted faces? Cognition, 47,25-57.
Riley, D.,& Costall, A. (1980). Comments on "Recognition of faces in the presence of two-dimensional sinusoidal masks." By Tieger and Ganz. Perception & Psychophysics,27,373-374.
Searcy, J. H.,& Bartlett, J. C. (1996). Inversion and processing of component and spatial relational information in faces. Journal of Experimental Psychology: Human Perception and Performance,22,904-915.
Sergent, J. (1984). An investigation into component and configural processes underlying face perception. British Journal of Psychology,75,221-242.
Sergent, J. (1989). Structural processing of faces. In A. W. Young & H. D. Ellis(Eds.), Handbook of research on face processing(pp.51-91). Adsterdam:Elsevier.
Tanaka, J. W.,& Farah, M. J. (1993). Parts and wholes in face recognition. Quarterly Journal of Experimental Psychology,46A,225-245.
Tanaka, J. W.,& Sengco, J. A. (1997). Features and their configuration in face recognition. Memory & Cognition,25,583-592.
Thompson, P. (1980). Margaret Thatcher:A new illusion. Perception,9,483-484.
Uttal, W. R., Baruch, T.,& Allen, L. (1995a). Combining image degradations in a recognition task. Perception & Psychophysics,57,682-691.
Uttal, W. R., Baruch, T.,& Allen, L. (1995b). The effect of combinations of image degradations in a discrimination task. Perception & Psychophysics,57,668-681.
Uttal, W. R., Baruch, T.,& Allen, L. (1997).A parametric study at face recognition when image degradations are combined. Spatial Vision,11,179-204.
Valentine, T. (1988). Upside-down faces:A review of the effect of inversion on face recognition. British Journal of Psychology,79,471-491.
White, M. (2002). Different spatial-relational information is used to recognize faces and emotional expressions. Perception,31,675-682.
White, M,& Li, J. (2006). Matching faces and expressions in pixilated and blurred photos. American Journal ofPsychology,119,21-28.
Yin, R. K. (1969). Looking at upside-down faces. Journal of Experimental Psychology,81,141-145.
Young, A. W., Hellawell, D.,& Hay, D. C. (1987). Configurational information in face perception. Perception,16,747-759.
Young, A. W., Rowland, D., Calder, A. J., Etcoff, N. L., Seth, A.,& Perrett, D. I. (1997). Megamixing facial expressions. Cognition,63,271-313.
Kirira, T.,& Endo, M. (1995). Happy face advantage in recognizing facial expressions. Acta Psychologica,89,149-163.
Bullier, J. (2001). Integrated model of visual processing. Brain Research Reviews,36, 96-107.
Fraser, I. H., Craig, G. L.,& Parker DM. Reaction time measures of feature saliency in schematic faces. Perception,19,661-673.
Haig, N.D. (1986). Exploring recognition with interchanged facial features. Perception,15,235-247.
Davies, G., Ellis, H.,& Shepherd, J. (1977). Cue saliency in faces as assessed by the 'Photofit'technique. Perception,6,263-269.
Frois-Wittman, J. (1930). The judgment of facial expression. Journal of Experimental Psychology,13,113-151.
Dunlap, K. (1927). Role of eye muscles and mouth muscles in the expression of emotions. Genetic Psychology Monographs,2,197-233.
Yuki, M., Maddux, W. W.,& Masuda, T. (2007). Are the windows to the soul the same in the East and West? Cultural differences in using the eyes and mouth as cues to recognize emotions in Japan and the United States. Journal of Experimental Social Psychology,43,303-311.
元晓旭,姜威.(2007).基于小波能量特征和FLD的人脸表情识别.电子器件,30.1720-1723.
Ambadar, Z., Schooler, J.W.,& Cohn, J.F. (2005). Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychological Science,16,403-410.
Barrera, M. E.,& Maurer, D. (1981). Recognition of mother's photographed face by the three-month-old infant. Child Development,52,714-716.
Bowlby, J. (1969). Attachment and loss:Vol.1. Attachment. New York:Basic Books.
Bruce, V,& Young, A. W. (1986). Understanding face recognition. British Journal of Psychology,77,305-327.
Bruce, V., Doyle, Y, Dench, N.,& Burton, M. (1991). Remembering facial configurations. Cognition,38,109-144.
Calder, A. J., Young, A. W., Keane, J.,& Dean, M. (2000). Configural information in facial expression perception. Journal of Experimental Psychology:Human Perception and Performance,26,527-551.
Calder, A. J., Young, A. W., Perrett, D. I., Etcoff, N. L.,& Rowland, D. (1996). Categorical perception of morphed facial expressions. Visual Cognition,3,81-117.
Calder, A. J., Young, A. W., Rowland, D.,& Perrett, D. I. (1997). Computer-enhanced emotion in facial expression. Proceedings of the Royal Society Londeon,264, 919-925.
Campbell, F. W.,& Robson, J. G. (1968). Application of fourier analysis to the visibility of gratings. The Journal of Physiology,197,551-566.
Campbell, R., Brooks, B., de Haan, E.,& Roberts, T. (1996). Dissociating face processing skills:Decisions about lip-read speech, expression and identity. Quarterly Journal of Experimental Psychology,49A,295-314.
Carey, S.,& Diamond, R. (1997).From piecemeal to configuraional representation of faces. Science,195,312-314.
Cooper, E. E.,& Wojan, T. J. (2000). Differences in the coding of spatial relations in face identification and basic-level object recognition. Journal of Experimental Psychology:Learning, Memory and Cognition,26,470-488.
Deruelle C, Fagot J. Categorizing Facial Identities, Emotions, and Gender:Attention to High-and Low-Spatial Frequencies by Children and Adults. Journal of Experimental Child Psychology,90,172-184.
Diamond, R.,& Carey, S. (1986). Why faces are and are not special:An effect of expertise. Journal of Experimental Psychology:General,115,107-117.
Ekman, P.,& Friesen, W. V. (1976). Pictures of facial affect. Palo Alto, California: Consulting Psychologists Press.
Ekman, P., Friesen, W. V.,& Ellsworth, P. (1982). Emotion in the human face. New York:Pergamon.
Ellison, J. W.,& Massaro, D. W. (1997). Featural evaluation, integration, and judgment of facial affect. Journal of Experimental Psychology:Human Perception and Performance,23,213-226.
Endo, M., Kirita, T.,& Abe, T. (1995). The effects of image blurring on the recognition of facial expressions. Tohoku Psyhcological Folia,54,68-82.
Etcoff, N. L.,& Magee, J. J., (1992). Categorical perception of facial expression. Cognition,44,227-240.
Fallshore, M.,& Bartholow, J. (2002). Recognition of emotion from inverted schematic drawings of faces. Perceptual and Motor Skills,96,236-244.
Farah, M. J. (1992). Is an object an object an object? Cognitive and neuropsychological investigation of domain specificity in visual object recognition. Current Directions in Psychological Science,1,164-169.
Farah, M. J., Tanaka, J. W.,& Drain, H. M. (1995). What causes the inversion effect? Journal of Experimental Psychology:Human Perception and Performance,21, 628-634.
Feyereisen, P., Malet, C.,& Martin, Y. (1986).'Is the faster processing modality-specific?'In:H.D. Ellis, M. A. Jeeves, F. Newcombe and A. w. Young (Eds.), Aspects of face processing. Dordrecht:Martinus Nijhoff.
Fiorentini, A., Maffei, L.,& Sandini, G. (1983). The role of high spatial frequencies in face perception. Perception,12,195-201.
Four-and Six-month-old infants'visual responses to joy, anger, and neutral expressions. Child Development,47,535-538.
Garner, W. R. (1978). Aspects of a stimulus:Features, dimensions, and configurations. In E. H. Rosch & B. B. Lloyd(Eds.), Cognition and categorization (pp.99-133). Hillsdale, NJ:Erlbaum.
Goffaux, V., Hault, B., Michel, C., Vuongo, Q. C.,& Rossion, B. (2005). The respective role of low and high spatial frequencies in supporting configural and featural processing of faces. Perception,34,77-86.
Goldstein, E. B. (1996). Sensation and Perception. Pacific Grove, CA:Brooks/Cole.
Goren D, Wilson H R. Quantifying Facial Expression Recognition across Viewing Conditions. Vision Research,46,1253-1262.
Haig, N. D. (1984). The effect of feature displacement on face recognition. Perception, 13,5050-512.
Herrmann, M. J., Aranda, D., Ellgring, H., Mueller, T. J., Strik, W. K., Heidrich, A., et al., (2002). International Journal of Psychophysiology,45,241-244.
Kirouac, G,& Dore, FY., (1983). Accuracy and latency of judgment of facial expressions of emotions. Perception & Motor Skills,57,683-686.
Ladavas, E., Umilta, C.,& Ricci-Bitti, PE.(1980). Evidence for sex differences in right-hemisphere dominance for emotions. Neuropsychologia,18,361-366.
McKelvie, S. (1995). Emotional expression in upside-down faces:Evidence for configurational and componential processing. British Journal of Social Psychology,34,325-334.
Parks, T. E., Coss, R. G,& Coss, C. S. (1985). Thatcher and the Cheshire cat:context and the processing of facial features, Perception,14,747-754.
Prkachin, G. C. (2003). The effects of orientation on detection and identification of facial expressions of emotion. British Journal of Psychology,94,45-62.
Rhodes, G (1988). Looking at faces:First-order and second-order features as determinants of facial appearance. Perception,17,43-63.
Rhodes, G, Brake, S.,& Atkinson, A. (1993). What's lost in inverted faces? Cognition, 47,25-57.
Riley, D.,& Costall, A. (1980). Comments on "Recognition of faces in the presence of two-dimensional sinusoidal masks." By Tieger and Ganz. Perception & Psychophysics,27,373-374.
Searcy, J. H.,& Bartlett, J. C. (1996). Inversion and processing of component and spatial relational information in faces. Journal of Experimental Psychology: Human Perception and Performance,22,904-915.
Sergent, J. (1984). An investigation into component and configural processes underlying face perception. British Journal of Psychology,75,221-242.
Sergent, J. (1989). Structural processing of faces. In A. W. Young & H. D. Ellis(Eds.), Handbook of research on face processing(pp.51-91). Adsterdam:Elsevier.
Tanaka, J. W.,& Farah, M. J. (1993). Parts and wholes in face recognition. Quarterly Journal of Experimental Psychology,46A,225-245.
Tanaka, J. W.,& Sengco, J. A. (1997). Features and their configuration in face recognition. Memory & Cognition,25,583-592.
Thompson, P. (1980). Margaret Thatcher:A new illusion. Perception,9,483-484.
Uttal, W. R., Baruch, T.,& Allen, L. (1995a). Combining image degradations in a recognition task. Perception & Psychophysics,57,682-691.
Uttal, W. R., Baruch, T.,& Allen, L. (1995b). The effect of combinations of image degradations in a discrimination task. Perception & Psychophysics,57,668-681.
Uttal, W. R., Baruch, T.,& Allen, L. (1997).A parametric study at face recognition when image degradations are combined. Spatial Vision,11,179-204.
Valentine, T. (1988). Upside-down faces:A review of the effect of inversion on face recognition. British Journal of Psychology,79,471-491.
White, M. (2002). Different spatial-relational information is used to recognize faces and emotional expressions. Perception,31,675-682.
White, M,& Li, J. (2006). Matching faces and expressions in pixilated and blurred photos. American Journal ofPsychology,119,21-28.
Yin, R. K. (1969). Looking at upside-down faces. Journal of Experimental Psychology,81,141-145.
Young, A. W., Hellawell, D.,& Hay, D. C. (1987). Configurational information in face perception. Perception,16,747-759.
Young, A. W., Rowland, D., Calder, A. J., Etcoff, N. L., Seth, A.,& Perrett, D. I. (1997). Megamixing facial expressions. Cognition,63,271-313.
Kirira, T.,& Endo, M. (1995). Happy face advantage in recognizing facial expressions. Acta Psychologica,89,149-163.
Bullier, J. (2001). Integrated model of visual processing. Brain Research Reviews,36, 96-107.
Fraser, I. H., Craig, G. L.,& Parker DM. Reaction time measures of feature saliency in schematic faces. Perception,19,661-673.
Haig, N.D. (1986). Exploring recognition with interchanged facial features. Perception,15,235-247.
Davies, G., Ellis, H.,& Shepherd, J. (1977). Cue saliency in faces as assessed by the 'Photofit'technique. Perception,6,263-269.
Frois-Wittman, J. (1930). The judgment of facial expression. Journal of Experimental Psychology,13,113-151.
Dunlap, K. (1927). Role of eye muscles and mouth muscles in the expression of emotions. Genetic Psychology Monographs,2,197-233.
Yuki, M., Maddux, W. W.,& Masuda, T. (2007). Are the windows to the soul the same in the East and West? Cultural differences in using the eyes and mouth as cues to recognize emotions in Japan and the United States. Journal of Experimental Social Psychology,43,303-311.