面孔知觉中的表情加工和视向加工
|
摘要
面孔表情（facial expression）和眼睛视向（gaze-direction）是面孔知觉中的两个最重要的动态特征，我们总是通过观察对方的视向和表情来推测其心理意图。鉴于这两种非语言的社会交流方式均为自动化加工的，且均含有接近-回避的趋向，因此本研究选择了高兴和害怕这两类典型的接近型趋向和回避型趋向的表情分别与直视朝向和转移朝向的眼睛相结合，将两种加工过程整合在一起考察，旨在探索表情加工和视向加工的相互关系，同时考察其时间进程。
实验一目的是筛选出表情（害怕和高兴）可辨度匹配的刺激材料用于正式实验，发现75%强度的两种类型表情在反应速度上是一致的。实验二和实验三采用修改过的Garner范式，探讨视向和表情两者是否存在干扰或者促进作用，基线水平下只有一个维度发生变化，而混合水平下两个维度都有变化，被试分别完成视向判断和表情判断任务。
实验二行为实验的结果发现：（1）视向加工速度比情绪加工速度慢；（2）视向与情绪的联合加工显著受任务的影响，视向判断任务中没有表情主效应，而表情判断任务则有显著的表情主效应和视向主效应，表现为高兴表情的加工优势和直视的加工优势；（3）视向和情绪相互作用的不对称性，体现在视向促进情绪加工，没有发现情绪对视向的促进或干扰。
实验三ERP实验的结果发现：（1）有显著的面孔加工情绪效应，主要包括P1效应、N170效应、LPC效应，没有发现显著的视向效应；（2）情绪加工和视向加工在时间进程上的差异体现在后期，情绪加工的晚期正慢波比视向加工提前出现100ms。
本研究主要得出以下结论：
(1)对眼睛注视方向的加工具有直视优势效应，但是该效应具有情境性，而且在大脑激活水平上没有体现，支持快速追踪调制理论模型。
(2)面孔表情加工在反应时上表现为高兴面孔的加工优势，而从大脑皮质诱发的角度上则在早期就表现出了负性偏向，害怕引起的振幅更高。
(3)面孔表情与视向的互相作用模式是否对称与刺激的可辨度，情绪唤醒度有很大关联，在本研究中发现了不对称的促进模式，视向对表情加工产生显著促进作用且与表情无关。
Eyes are central to various aspects of face processing, including face perception,gender discrimination, identity recognition and facial expression discrimination, and facialexpression and gaze-direction are two important dynamic aspects of human faces.Expressions communicate the internal emotional state of others while gaze-direction offerscues to their attentional focus and future intentions.
Here we explored the relationship between the processing of facial expression and theprocessing of gaze-direction. In the current study24subjects were instructed to judge thegaze-direction (direct or averted gaze) or expression (happy or fear) of presented faceswhile we recorded reaction time and brain potentials with event-related potential(ERP)technique.
Behavioral results confirmed the prediction that gaze-direction facilitated theprocessing of facially emotional expressions (both fear and happy), however, emotionalexpression had no reciprocal influence on judgment of gaze-direction. Data of ERPsrevealed that amplitudes elicited by fearful faces were larger than those elicited by happyfrom very early stage even from about100ms, consistent with the presence of a ‘negativitybias’. Even we found that direct gaze faces were recognized faster than averted-gaze faces,but this effect of direct gaze had little demonstration in brain potentials. The brain waves ofgaze and emotional expressions are integrated at the early stages of visual processing, andthese two processing streams were dissociable at no earlier than300ms. The late positivecomponent of emotional processing appeared earlier than that of gaze-direction processing,consistent with the behavioral results that RTs for expression judgements were faster thangaze-direction judgements.
实验一目的是筛选出表情（害怕和高兴）可辨度匹配的刺激材料用于正式实验，发现75%强度的两种类型表情在反应速度上是一致的。实验二和实验三采用修改过的Garner范式，探讨视向和表情两者是否存在干扰或者促进作用，基线水平下只有一个维度发生变化，而混合水平下两个维度都有变化，被试分别完成视向判断和表情判断任务。
实验二行为实验的结果发现：（1）视向加工速度比情绪加工速度慢；（2）视向与情绪的联合加工显著受任务的影响，视向判断任务中没有表情主效应，而表情判断任务则有显著的表情主效应和视向主效应，表现为高兴表情的加工优势和直视的加工优势；（3）视向和情绪相互作用的不对称性，体现在视向促进情绪加工，没有发现情绪对视向的促进或干扰。
实验三ERP实验的结果发现：（1）有显著的面孔加工情绪效应，主要包括P1效应、N170效应、LPC效应，没有发现显著的视向效应；（2）情绪加工和视向加工在时间进程上的差异体现在后期，情绪加工的晚期正慢波比视向加工提前出现100ms。
本研究主要得出以下结论：
(1)对眼睛注视方向的加工具有直视优势效应，但是该效应具有情境性，而且在大脑激活水平上没有体现，支持快速追踪调制理论模型。
(2)面孔表情加工在反应时上表现为高兴面孔的加工优势，而从大脑皮质诱发的角度上则在早期就表现出了负性偏向，害怕引起的振幅更高。
(3)面孔表情与视向的互相作用模式是否对称与刺激的可辨度，情绪唤醒度有很大关联，在本研究中发现了不对称的促进模式，视向对表情加工产生显著促进作用且与表情无关。
Eyes are central to various aspects of face processing, including face perception,gender discrimination, identity recognition and facial expression discrimination, and facialexpression and gaze-direction are two important dynamic aspects of human faces.Expressions communicate the internal emotional state of others while gaze-direction offerscues to their attentional focus and future intentions.
Here we explored the relationship between the processing of facial expression and theprocessing of gaze-direction. In the current study24subjects were instructed to judge thegaze-direction (direct or averted gaze) or expression (happy or fear) of presented faceswhile we recorded reaction time and brain potentials with event-related potential(ERP)technique.
Behavioral results confirmed the prediction that gaze-direction facilitated theprocessing of facially emotional expressions (both fear and happy), however, emotionalexpression had no reciprocal influence on judgment of gaze-direction. Data of ERPsrevealed that amplitudes elicited by fearful faces were larger than those elicited by happyfrom very early stage even from about100ms, consistent with the presence of a ‘negativitybias’. Even we found that direct gaze faces were recognized faster than averted-gaze faces,but this effect of direct gaze had little demonstration in brain potentials. The brain waves ofgaze and emotional expressions are integrated at the early stages of visual processing, andthese two processing streams were dissociable at no earlier than300ms. The late positivecomponent of emotional processing appeared earlier than that of gaze-direction processing,consistent with the behavioral results that RTs for expression judgements were faster thangaze-direction judgements.
引文
Adams, R. B., Jr.,&Kleck, R. E.(2003). Perceived gaze direction and the processingof facial displays of emotion. Psychological Science,14,644-647.
Adams, R. B., Jr.,&Kleck, R. E.(2005). Effects of direct and averted gaze on theperception of facially communicated emotion. Emotion (Washington, DC),5,3-11.
Adams, R. B., Jr., Ambady, N., Macrae, C. N.,&Kleck, R. E.(2006). Emotionalexpressions forecast approach-avoidance behavior. Motivation and Emotion,30,177-186.
Adolphs, R., Gosselin, F., Buchanan, T.W., Tranel, D., Schyns, P.,&Damasio, A.R.(2005). A mechanism for impaired fear recognition after amygdala damage. Nature,433(7021),68-72.
Adolphs, R.(2009). The social brain: neural basis of social knowledge. Ann. Rev.Psychol,60,693-716.
Allison, T., Puce. A.,&McCarthy, G.(2000). Social perception from visual cues: roleof the STS region. Trends Cogn. Sci,4(7),267-278.
Balconi&Pozzoli.(2003). Face-selective processing and the effect of pleasant andunpleasant emotional expressions on ERP correlates. International Journal ofPsychophysiology,49(1),67-74.
Bar, M., Kassam, K.S., Ghuman, A.S., Boshyan, J., Schmid, A.M., Dale, A.M., et al.(2006). Top-down facilitation of visual recognition. Proc. Natl. Acad. Sci. U. S. A.103(2),449–454.
Bar-Haim, Y., Lamy, D.,&Glickman, S.(2005). Attentional bias in anxiety: abehavioral and ERP study. Brain Cogn,59,11-22.
Baron-Cohen, S.(1997).Mindblindness:An essay on autism and theory ofmind.Cam-bridge, MA: MIT Press.
Batty, M.,&Taylor, M.J.(2003). Early processing of the six basic facial emotionalexpressions. Cogn. Brain Res,17,613-620.
Bindemann, M., Burton, M. A.,&Langton, S. R. H.(2008). How do eye gaze andfacial expression interact? Visual Cognition,16,708-733.
Bentin, S., Allison, T., Puce, A., Perez, E.,&McCarthy, G.(1996).Electrophysiological studies of face perception in humans. J. Cogn. Neurosci,8,551-565.
Bentin, S., Golland, Y., Flevaris, A., Robertson, L.C.,&Moscovitch, M.(2006).Processing the trees and the forest during initial stages of face perception:electrophysiological evidence. J. Cogn. Neurosci,18(8),1406-1421.
Bristow, D., Rees, G.,&Frith, C.(2007). Social interaction modifies neural responseto gaze shifts. Soc. Cogn. Affect. Neurosci,2,52-61.
Calder, A.J., Young, A.W., Keane, J.,&Dean, M.(2000).Configural information infacial expression perception. Exp. Psychol. Hum. Percept. Perform,26(2):527-551.
Calder, A.J., Lawrence, A.D., Keane, J., Scott, S.K., Owen, A.M., Christoffels, I., et al.(2002). Reading the mind from eye gaze. Neuropsychologia,40(8),1129-1138.
Calder, A.J., Beaver, J.D., Winston, J.S., Dolan, R.J., Jenkins, R., Eger, E., et al.(2007). Separate coding of different gaze directions in the superior temporal sulcus andinferior parietal lobule. Curr. Biol,17(1),20-25.
Campanella, S, Gaspard, C, Debatisse, D, Bruyer, R., Crommelinck, M.,&Guerit,J-M.(2002). Discrimination of emotional facial expressions in a visual oddball task: AnERP study. Biol Psychol,59,171-186.
Carretié, L., Mercado, F., Tapia, M.,&Hinojosa, J.A.,(2001). Emotion, attention, andthe ‘negativity bias’, studied through event-related potentials. Int. J. Psychophysiol,41,75-85.
Carrick, O.K., Thompson, J.C., Epling, J.A.,&Puce, A.,(2007). It’s all in the eyes:neural responses to socially significant gaze shifts. Neuroreport,18(8),763-766.
Conty, L., Tijus, C., Hugueville, L., Coelho, E.,&George, N.(2006). Searching forasymmetries in the detection of gaze contact versus averted gaze under different headviews: a behavioural study. Spat. Vis,19(6),529-545.
Conty, L., N’Diaye, K., Tijus, C.,&George, N.(2007). When eye creates the contact!ERP evidence for early dissociation between direct and averted gaze motion processing.Neuropsychologia,45(13),3024–3037.
Driver, J., Davis, G., Ricciardelli, P., Kidd, P., Maxwell, E.,&Baron-Cohen, S.(1999).Gaze perception triggers reflexive visuospatial orienting. Visual Cognition,6,509-540.
Eimer, M.,&Holmes, A.(2002). An ERP study in the time course of emotional faceprocessing. NeuroReport,13,427-431.
Eimer, M., Holmes, A.,&McGlone, F.(2003). The role of spatial attention in theprocessing of facial expression: an ERP study of rapid brain responses to six basicemotions. Cogn. Affect. Behav. Neurosci.3,97-110.
Ekman, P.,&Friesen,W.V.(1971). Constants across cultures in the face and emotion.Pers. Soc.Psychol.,17(2),124-129.
Ekman, P.,&Friesen, W. V.(1978). The facial action coding system. Palo Alto, CA:Consulting Psychologists Press.
Esslen,M., Pascual-Marqui, R.D., Hell, D., Kochi, K.,&Lehmann, D.(2004). Brainareas and time course of emotional processing. NeuroImage,21,1189-1203.
Farroni, T., Csibra, G., Simion, G.,&Johnson, M.H.(2002). Eye contact detection inhumans from birth. Proc. Natl. Acad. Sci. U.S.A.99(14),9602-9605.
Farroni, T., Menon, E., Rigato, S.,&Johnson, M.H.(2007). The perception of facialexpressions innewborns. European Journal of Developmental Psychology,4,2-13.
Fichtenholtz, H. M., Hopfinger, J. B., Graham, R., Detwiler, J. M.,&LaBar, K. S.(2007). Happy and fearful emotion in cues and targets modulate event-related potentialindices of gaze-directed attentional orienting. Social, Cognitive, and AffectiveNeuroscience,2(4),323-333.
Fox, E., Mathews, A., Calder, A. J.,&Yiend, J.(2007). Anxiety and sensitivity togaze direction in emotionally expressive faces. Emotion (Washington, DC),7,478-486.
Garner, W. R.(1976). Interaction of stimulus dimensions in concept and choiceprocesses. Cognitive Psychology,8,98-123.
Ganel, T., Goshen-Gottstein, Y.,&Goodale, M. A.(2005). Interactions between theprocessing of gaze direction and facial expression. Vision Research,45,1191–1200.
George, N., Driver, J.,&Dolan, R.J.(2001). Seen gaze-direction modulates fusiformactivity and its coupling with other brain areas during face processing. Neuro-image,13(6Pt1),1102–1112.
Graham, R.,&LaBar, K. S.(2007). Garner interference reveals dependenciesbetween emotional expression and gaze in face perception. Emotion (Washington, DC),7,296–313.
Grice, S.J., Halit, H., Farroni, T., Baron-Cohen, S., Bolton, P.,&Johnson, M.H.(2005). Neural correlates of eye-gaze detection in young children with autism. Cortex,41(3),342–353.
Grosbras, M.H., Laird, A.R.,&Paus, T.(2005). Cortical regions involved in eyemovements, shifts of attention, and gaze perception. Hum. Brain Mapp,25(1),140-154.
Haxby, J.V., Hoffman, E.A.,&Gobbini, M.I.(2000). The distributed human neuralsystem for face perception. Trends Cogn. Sci.,4(6),223-233.
Henderson, J. M., Williams, C. C.,&Falk, R. J.(2005). Eye movements arefunctional during face learning. Memory and Cognition,33(1),98-106.
Hess, U., Adams, R. B., Jr.,&Kleck, R. E.(2007). When two do the same, it mightnot mean the same: The perception of emotional expressions shown by men and women. InU. Hess&P. Philippot (Eds.), Group dynamics and emoitonal expression:Studies inemotion and social interaction, second series (pp.182-190). New York: CambridgeUniversity Press.
Hoffman, E.A.,&Haxby, J.V.(2000). Distinct representations of eye gaze andidentity in the distributed human neural system for face perception. Nat. Neurosci,3(1),80-84.
Holmes, A., Vuilleumier, P., Eimer, M.(2003). The processing of emotional facialexpression is gated by spatial attention: evidence from event-related brain potentials.Cogn. Brain Res,16,174-184.
Hooker, C.I., Paller, K.A., Gitelman, D.R., Parrish, T.B., Mesulam, M.M.,&Reber,P.J.(2003). Brain networks for analyzing eye gaze. Cogn. Brain Res,17(2),406-418.
Itier,R.J.&Batty M.(2009). Neural bases of eye and gaze processing:The core ofsocial cognition. Neuroscience and Biobehavioral Reviews,33,843-863.
Itier, R.J., Latinus, M.,&Taylor, M.J.(2006b). Face, eye and object early processing:what is the face specificity? Neuroimage,29(2),667–676.
Kampe, K. K. W., Frith, C. D., Dolan, R. J.,&Frith, U.(2001). Reward value ofattractiveness and gaze. Nature,413,589.
Kampe, K.K.W., Frith, C. D.,&Frith, U.(2003)."Hey John": signals conveyingcommunicative intention toward the self activate brain regions associated with"mentalizing," regardless of modality. Neurosci,23(12),5258-5263.
Kawashima, R., Sugiura, M., Kato, T., Nakamura, A., Hatan, K., Ito, K., et al.(1999).The human amygdala plays an important role in gaze monitoring. Brain,122,779-783.
Kingstone, A., Tipper, C., Ristic, J.,&Ngan, E.(2004). The eyes have it! An fMRIinvestigation. Brain Cogn,55(2),269-271.
Klucharev, V.,&Sams, M.(2004). Interaction of gaze direction and facial expressionsprocessing: ERP study. Neuroreport,15(4),621-625.
Krolak–Salmon P,&Fischer C.(2001). Processing of Facial Emotional Expression:Spatio-temporal Data as Assessed by Scaple Event-related Potentials. Buropean Journal ofNeuroscience,13,987-994.
Lobmaier,J.S., Tiddeman,B.P.&Perrett,D.I.(2008). Emotional Expression ModulatesPerceived Gaze Direction. Emotion,8(4),573-577.
Luo, W.B., Feng, W.F., He, W.Q., Wang, N.Y.,&Luo, Y.J.(2010). Three stages offacial expression processing: ERP study with rapid serial visual presentation. NeuroImage,49,1857-1867.
Macrae, C.N., Hood, B.M., Milne, A.B., Rowe, A.C.,&Mason, M.F.(2002). Are youlooking at me? Gaze and person perception. Psychological Science,13,460-464.
Marsh, A.A., Kozak, M.N.,&Ambaby, N.(2007). Accurate identification of fearfacial expressions predicts prosocial behavior. Emotion,7(2),239-251.
Miltner, W.H.R., Trippe, R.H., Krieschel,S., Gutberlet, I., Hecht, H.,&Weiss, T.(2005). Event-related brain potentials and affective responses to threat in spidersnake-phobic and non-phobic subjects. Int. J. Psychophy siol,57,43-52.
Morris, J. S., Friston, K. J., Buechel, C., Frith, C. D., Young, A. W., Calder, A. J., et al.(1998). A neuromodulatory role for the human amygdala in processing emotional facialexpressions. Brain,121,47-57.
Nichols, K.A.,&Champness, B.G.(1971). Eye gaze and GSR. J. Exp. Soc. Psychol,7,623-626.
Pageler, N.M., Menon, V., Merin, N.M., Eliez, S., Brown, W.E.,&Reiss, A.L.(2003).Effect of head orientation on gaze processing in fusiform gyrus and superior temporalsulcus. Neuroimage,20(1),318-329.
Pelphrey, K., Singerman, J. D., Allison, T.,&McCarthy, G.(2003). Brain activationevoked by perception of gaze shifts: The influence of context. Neuropsychologia,41,156-170.
Pelphrey, K.A., Viola, R.J.,&McCarthy, G.(2004). When strangers pass: processingof mutual and averted social gaze in the superior temporal sulcus. Psychol. Sci.,15(9),598-603.
Pelphrey, K.A.,&Morris, J.P.(2006). Brain Mechanisms for Interpreting the Actionsof others from biological-motion cues. Curr. Dir. Psychol. Sci,15,136-140.
Perrett, D. I., Smith, P. A. J., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, A. D.&Jeeves, M. A.(1985). Visual cells in the temporal cortex sensitive to face view and gazedirection. Proceedings of the Royal Society of London, Series B: Biological Sciences,223(1232),293–317.
Pourtois, G., Gelder, B., Vroomen, J., Rossion, B.,&Crommelinck, M.(2000). Thetime-course of intermodal binding between seeing and hearing affective information.Neuroreport,11,1329–1333.
Pourtois, G., Sander, D., Andres, M., Grandjean, D., Reveret, L., Olivier, E., et al.(2004). Dissociable roles of the human somatosensory and superior temporal cortices forprocessing social face signals. European Journal of Neuroscience,20,3507-3515.
Reginald, B., Adams J., Robert G.,&Franklin, J.(2009). Influence of emotionalexpression on the processing of gaze direction. Motivation and Emotion,33(2),106-112.
Rossion, B., Delvenne, J.F., Debatisse, D., Goffaux, V., Bruyer, R., Crommelinck,M.,et al.(1999b). Spatio-temporal localization of the face inversion effect: an event-relatedpotentials study. Biol. Psychol,50(3),173–189.
Sabbagh, M.A., Moulson, M.C.,&Harkness, K.L.(2004). Neural correlates of mentalstate decoding in human adults: an event-related potential study. J. Cogn. Neurosci,16(3),415–426.
Sander, D., Grandjean, D., Kaiser, S., Wehrle, T.,&Scherer, K. R.(2007). Interactioneffects of perceived gaze direction and dynamic facial expression: Evidence for appraisaltheories of emotion. The European Journal of Cognitive Psychology,19,470-480.
Santos, I.M., Iglesias, J., Olivares, E.I.,&Young, A.W.(2008). Differential effects ofobject-based attention on evoked potentials to fearful and disgustedfaces.Neuropsychologia,46,1468-1479.
Sato, W., Yoshikawa, S., Kochiyama, T.,&Matsumura, M.(2004). The amygdaleprocesses the emotional significance of facial expressions: an fMRI investigation using theinteraction between expression and face direction. Neuroimage,22(2),1006-1013.
Schweinberger, S.R., Kloth, N.,&Jenkins, R.(2007). Are you looking at me? Neuralcorrelates of gaze adaptation. Neuroreport,18(7),693–696.
Senju, A.,&Hasegawa, T.(2005). Direct gaze captures visuospatial attention. Vis.Cogn,12,127-144.
Shibata, T., Nishijo, H., Tamura, R., Miyamoto, K., Eifuku, S., Endo, S., et al.(2002).Generators of visual evoked potentials for faces and eyes in the human brain as determinedby dipole localization. Brain Topogr,15(1),51–63.
Singer, T.(2006). The neuronal basis and ontogeny of empathy and mind reading:Review of literature and implications for future research. Neurosci. Biobehav. Rev,30,855-863.
Smith, M.L., Cottrell, G.W., Gosselin, F.,&Schyns, P.G.(2005). Transmitting anddecoding facial expressions. Psychol. Sci,16(3),184-189.
Smith, N.K., Cacioppo, J.T., Larsen, J.T.,&Chartrand, T.L.(2003). May I have yourattention, please: electrocortical responses to positive and negative stimuli.Neuropsychologia,41,171-183.
Smith, A., Puce, A.,&Allison, T.(2000). ERPs Evoked by viewing facial movements.Cognitive Neuropsychology,17,221-239.
Utama, N.P., Takemoto,A., Koike, Y.,&Nakamura, K.(2009). Phased processing offacial emotion: An ERP study. Neuroscience Research,64,30–40.
Vuilleumier, P.&Pourtois, G.(2007). Distributed and interactive brain mechanismsduring emotion face perception: evidence from functional neuroimaging.Neuropsychologia,45,174-194.
Whalen, P. J., Shin, L. M., McInerney, S. C., Fischer, H., Wright, C.,&Rauch, S. L.(2001). A functional MRI study of human amygdala responses to facial expressions of fearversus anger. Emotion,1(1),70-83.
Whalen, P. J., Kagan, J., Cook, R. G., Davis, F. C., Kim, H., Polis, S., et al.(2004).Human amygdala responsivity to masked fearful eye whites. Science,306(5704),2061.
Wicker, B., Perrett, D. I., Baron-Cohen, S.,&Decety, J.(2003). Being the target ofanother’s emotion: A PET study. Neuropsychologia,41,139-146.
Wild-Wall, N., Dimigen, O.,&Sommer, W.(2008). Interaction of facial expressionsand familiarity: ERP evidence. Biol. Psychol.77(2),138-149.
Williams, L.M., Palmer, D., Lidde ll, B.J., Song, L.,&Gordon, E.(2006). The whenand where of perceiving signals of threat versus non-threat. Neuroimage,31,458-467.
Young, A., Perrett, D., Calder, A., Sprengelmeyer, R.,&Ekman, P.(2002). FacialExpressio ns of Emotion—Stimu li and Tests. Thames Valley Test Company, Bury St. Edmunds, Suffolk, England.
Adams, R. B., Jr.,&Kleck, R. E.(2005). Effects of direct and averted gaze on theperception of facially communicated emotion. Emotion (Washington, DC),5,3-11.
Adams, R. B., Jr., Ambady, N., Macrae, C. N.,&Kleck, R. E.(2006). Emotionalexpressions forecast approach-avoidance behavior. Motivation and Emotion,30,177-186.
Adolphs, R., Gosselin, F., Buchanan, T.W., Tranel, D., Schyns, P.,&Damasio, A.R.(2005). A mechanism for impaired fear recognition after amygdala damage. Nature,433(7021),68-72.
Adolphs, R.(2009). The social brain: neural basis of social knowledge. Ann. Rev.Psychol,60,693-716.
Allison, T., Puce. A.,&McCarthy, G.(2000). Social perception from visual cues: roleof the STS region. Trends Cogn. Sci,4(7),267-278.
Balconi&Pozzoli.(2003). Face-selective processing and the effect of pleasant andunpleasant emotional expressions on ERP correlates. International Journal ofPsychophysiology,49(1),67-74.
Bar, M., Kassam, K.S., Ghuman, A.S., Boshyan, J., Schmid, A.M., Dale, A.M., et al.(2006). Top-down facilitation of visual recognition. Proc. Natl. Acad. Sci. U. S. A.103(2),449–454.
Bar-Haim, Y., Lamy, D.,&Glickman, S.(2005). Attentional bias in anxiety: abehavioral and ERP study. Brain Cogn,59,11-22.
Baron-Cohen, S.(1997).Mindblindness:An essay on autism and theory ofmind.Cam-bridge, MA: MIT Press.
Batty, M.,&Taylor, M.J.(2003). Early processing of the six basic facial emotionalexpressions. Cogn. Brain Res,17,613-620.
Bindemann, M., Burton, M. A.,&Langton, S. R. H.(2008). How do eye gaze andfacial expression interact? Visual Cognition,16,708-733.
Bentin, S., Allison, T., Puce, A., Perez, E.,&McCarthy, G.(1996).Electrophysiological studies of face perception in humans. J. Cogn. Neurosci,8,551-565.
Bentin, S., Golland, Y., Flevaris, A., Robertson, L.C.,&Moscovitch, M.(2006).Processing the trees and the forest during initial stages of face perception:electrophysiological evidence. J. Cogn. Neurosci,18(8),1406-1421.
Bristow, D., Rees, G.,&Frith, C.(2007). Social interaction modifies neural responseto gaze shifts. Soc. Cogn. Affect. Neurosci,2,52-61.
Calder, A.J., Young, A.W., Keane, J.,&Dean, M.(2000).Configural information infacial expression perception. Exp. Psychol. Hum. Percept. Perform,26(2):527-551.
Calder, A.J., Lawrence, A.D., Keane, J., Scott, S.K., Owen, A.M., Christoffels, I., et al.(2002). Reading the mind from eye gaze. Neuropsychologia,40(8),1129-1138.
Calder, A.J., Beaver, J.D., Winston, J.S., Dolan, R.J., Jenkins, R., Eger, E., et al.(2007). Separate coding of different gaze directions in the superior temporal sulcus andinferior parietal lobule. Curr. Biol,17(1),20-25.
Campanella, S, Gaspard, C, Debatisse, D, Bruyer, R., Crommelinck, M.,&Guerit,J-M.(2002). Discrimination of emotional facial expressions in a visual oddball task: AnERP study. Biol Psychol,59,171-186.
Carretié, L., Mercado, F., Tapia, M.,&Hinojosa, J.A.,(2001). Emotion, attention, andthe ‘negativity bias’, studied through event-related potentials. Int. J. Psychophysiol,41,75-85.
Carrick, O.K., Thompson, J.C., Epling, J.A.,&Puce, A.,(2007). It’s all in the eyes:neural responses to socially significant gaze shifts. Neuroreport,18(8),763-766.
Conty, L., Tijus, C., Hugueville, L., Coelho, E.,&George, N.(2006). Searching forasymmetries in the detection of gaze contact versus averted gaze under different headviews: a behavioural study. Spat. Vis,19(6),529-545.
Conty, L., N’Diaye, K., Tijus, C.,&George, N.(2007). When eye creates the contact!ERP evidence for early dissociation between direct and averted gaze motion processing.Neuropsychologia,45(13),3024–3037.
Driver, J., Davis, G., Ricciardelli, P., Kidd, P., Maxwell, E.,&Baron-Cohen, S.(1999).Gaze perception triggers reflexive visuospatial orienting. Visual Cognition,6,509-540.
Eimer, M.,&Holmes, A.(2002). An ERP study in the time course of emotional faceprocessing. NeuroReport,13,427-431.
Eimer, M., Holmes, A.,&McGlone, F.(2003). The role of spatial attention in theprocessing of facial expression: an ERP study of rapid brain responses to six basicemotions. Cogn. Affect. Behav. Neurosci.3,97-110.
Ekman, P.,&Friesen,W.V.(1971). Constants across cultures in the face and emotion.Pers. Soc.Psychol.,17(2),124-129.
Ekman, P.,&Friesen, W. V.(1978). The facial action coding system. Palo Alto, CA:Consulting Psychologists Press.
Esslen,M., Pascual-Marqui, R.D., Hell, D., Kochi, K.,&Lehmann, D.(2004). Brainareas and time course of emotional processing. NeuroImage,21,1189-1203.
Farroni, T., Csibra, G., Simion, G.,&Johnson, M.H.(2002). Eye contact detection inhumans from birth. Proc. Natl. Acad. Sci. U.S.A.99(14),9602-9605.
Farroni, T., Menon, E., Rigato, S.,&Johnson, M.H.(2007). The perception of facialexpressions innewborns. European Journal of Developmental Psychology,4,2-13.
Fichtenholtz, H. M., Hopfinger, J. B., Graham, R., Detwiler, J. M.,&LaBar, K. S.(2007). Happy and fearful emotion in cues and targets modulate event-related potentialindices of gaze-directed attentional orienting. Social, Cognitive, and AffectiveNeuroscience,2(4),323-333.
Fox, E., Mathews, A., Calder, A. J.,&Yiend, J.(2007). Anxiety and sensitivity togaze direction in emotionally expressive faces. Emotion (Washington, DC),7,478-486.
Garner, W. R.(1976). Interaction of stimulus dimensions in concept and choiceprocesses. Cognitive Psychology,8,98-123.
Ganel, T., Goshen-Gottstein, Y.,&Goodale, M. A.(2005). Interactions between theprocessing of gaze direction and facial expression. Vision Research,45,1191–1200.
George, N., Driver, J.,&Dolan, R.J.(2001). Seen gaze-direction modulates fusiformactivity and its coupling with other brain areas during face processing. Neuro-image,13(6Pt1),1102–1112.
Graham, R.,&LaBar, K. S.(2007). Garner interference reveals dependenciesbetween emotional expression and gaze in face perception. Emotion (Washington, DC),7,296–313.
Grice, S.J., Halit, H., Farroni, T., Baron-Cohen, S., Bolton, P.,&Johnson, M.H.(2005). Neural correlates of eye-gaze detection in young children with autism. Cortex,41(3),342–353.
Grosbras, M.H., Laird, A.R.,&Paus, T.(2005). Cortical regions involved in eyemovements, shifts of attention, and gaze perception. Hum. Brain Mapp,25(1),140-154.
Haxby, J.V., Hoffman, E.A.,&Gobbini, M.I.(2000). The distributed human neuralsystem for face perception. Trends Cogn. Sci.,4(6),223-233.
Henderson, J. M., Williams, C. C.,&Falk, R. J.(2005). Eye movements arefunctional during face learning. Memory and Cognition,33(1),98-106.
Hess, U., Adams, R. B., Jr.,&Kleck, R. E.(2007). When two do the same, it mightnot mean the same: The perception of emotional expressions shown by men and women. InU. Hess&P. Philippot (Eds.), Group dynamics and emoitonal expression:Studies inemotion and social interaction, second series (pp.182-190). New York: CambridgeUniversity Press.
Hoffman, E.A.,&Haxby, J.V.(2000). Distinct representations of eye gaze andidentity in the distributed human neural system for face perception. Nat. Neurosci,3(1),80-84.
Holmes, A., Vuilleumier, P., Eimer, M.(2003). The processing of emotional facialexpression is gated by spatial attention: evidence from event-related brain potentials.Cogn. Brain Res,16,174-184.
Hooker, C.I., Paller, K.A., Gitelman, D.R., Parrish, T.B., Mesulam, M.M.,&Reber,P.J.(2003). Brain networks for analyzing eye gaze. Cogn. Brain Res,17(2),406-418.
Itier,R.J.&Batty M.(2009). Neural bases of eye and gaze processing:The core ofsocial cognition. Neuroscience and Biobehavioral Reviews,33,843-863.
Itier, R.J., Latinus, M.,&Taylor, M.J.(2006b). Face, eye and object early processing:what is the face specificity? Neuroimage,29(2),667–676.
Kampe, K. K. W., Frith, C. D., Dolan, R. J.,&Frith, U.(2001). Reward value ofattractiveness and gaze. Nature,413,589.
Kampe, K.K.W., Frith, C. D.,&Frith, U.(2003)."Hey John": signals conveyingcommunicative intention toward the self activate brain regions associated with"mentalizing," regardless of modality. Neurosci,23(12),5258-5263.
Kawashima, R., Sugiura, M., Kato, T., Nakamura, A., Hatan, K., Ito, K., et al.(1999).The human amygdala plays an important role in gaze monitoring. Brain,122,779-783.
Kingstone, A., Tipper, C., Ristic, J.,&Ngan, E.(2004). The eyes have it! An fMRIinvestigation. Brain Cogn,55(2),269-271.
Klucharev, V.,&Sams, M.(2004). Interaction of gaze direction and facial expressionsprocessing: ERP study. Neuroreport,15(4),621-625.
Krolak–Salmon P,&Fischer C.(2001). Processing of Facial Emotional Expression:Spatio-temporal Data as Assessed by Scaple Event-related Potentials. Buropean Journal ofNeuroscience,13,987-994.
Lobmaier,J.S., Tiddeman,B.P.&Perrett,D.I.(2008). Emotional Expression ModulatesPerceived Gaze Direction. Emotion,8(4),573-577.
Luo, W.B., Feng, W.F., He, W.Q., Wang, N.Y.,&Luo, Y.J.(2010). Three stages offacial expression processing: ERP study with rapid serial visual presentation. NeuroImage,49,1857-1867.
Macrae, C.N., Hood, B.M., Milne, A.B., Rowe, A.C.,&Mason, M.F.(2002). Are youlooking at me? Gaze and person perception. Psychological Science,13,460-464.
Marsh, A.A., Kozak, M.N.,&Ambaby, N.(2007). Accurate identification of fearfacial expressions predicts prosocial behavior. Emotion,7(2),239-251.
Miltner, W.H.R., Trippe, R.H., Krieschel,S., Gutberlet, I., Hecht, H.,&Weiss, T.(2005). Event-related brain potentials and affective responses to threat in spidersnake-phobic and non-phobic subjects. Int. J. Psychophy siol,57,43-52.
Morris, J. S., Friston, K. J., Buechel, C., Frith, C. D., Young, A. W., Calder, A. J., et al.(1998). A neuromodulatory role for the human amygdala in processing emotional facialexpressions. Brain,121,47-57.
Nichols, K.A.,&Champness, B.G.(1971). Eye gaze and GSR. J. Exp. Soc. Psychol,7,623-626.
Pageler, N.M., Menon, V., Merin, N.M., Eliez, S., Brown, W.E.,&Reiss, A.L.(2003).Effect of head orientation on gaze processing in fusiform gyrus and superior temporalsulcus. Neuroimage,20(1),318-329.
Pelphrey, K., Singerman, J. D., Allison, T.,&McCarthy, G.(2003). Brain activationevoked by perception of gaze shifts: The influence of context. Neuropsychologia,41,156-170.
Pelphrey, K.A., Viola, R.J.,&McCarthy, G.(2004). When strangers pass: processingof mutual and averted social gaze in the superior temporal sulcus. Psychol. Sci.,15(9),598-603.
Pelphrey, K.A.,&Morris, J.P.(2006). Brain Mechanisms for Interpreting the Actionsof others from biological-motion cues. Curr. Dir. Psychol. Sci,15,136-140.
Perrett, D. I., Smith, P. A. J., Potter, D. D., Mistlin, A. J., Head, A. S., Milner, A. D.&Jeeves, M. A.(1985). Visual cells in the temporal cortex sensitive to face view and gazedirection. Proceedings of the Royal Society of London, Series B: Biological Sciences,223(1232),293–317.
Pourtois, G., Gelder, B., Vroomen, J., Rossion, B.,&Crommelinck, M.(2000). Thetime-course of intermodal binding between seeing and hearing affective information.Neuroreport,11,1329–1333.
Pourtois, G., Sander, D., Andres, M., Grandjean, D., Reveret, L., Olivier, E., et al.(2004). Dissociable roles of the human somatosensory and superior temporal cortices forprocessing social face signals. European Journal of Neuroscience,20,3507-3515.
Reginald, B., Adams J., Robert G.,&Franklin, J.(2009). Influence of emotionalexpression on the processing of gaze direction. Motivation and Emotion,33(2),106-112.
Rossion, B., Delvenne, J.F., Debatisse, D., Goffaux, V., Bruyer, R., Crommelinck,M.,et al.(1999b). Spatio-temporal localization of the face inversion effect: an event-relatedpotentials study. Biol. Psychol,50(3),173–189.
Sabbagh, M.A., Moulson, M.C.,&Harkness, K.L.(2004). Neural correlates of mentalstate decoding in human adults: an event-related potential study. J. Cogn. Neurosci,16(3),415–426.
Sander, D., Grandjean, D., Kaiser, S., Wehrle, T.,&Scherer, K. R.(2007). Interactioneffects of perceived gaze direction and dynamic facial expression: Evidence for appraisaltheories of emotion. The European Journal of Cognitive Psychology,19,470-480.
Santos, I.M., Iglesias, J., Olivares, E.I.,&Young, A.W.(2008). Differential effects ofobject-based attention on evoked potentials to fearful and disgustedfaces.Neuropsychologia,46,1468-1479.
Sato, W., Yoshikawa, S., Kochiyama, T.,&Matsumura, M.(2004). The amygdaleprocesses the emotional significance of facial expressions: an fMRI investigation using theinteraction between expression and face direction. Neuroimage,22(2),1006-1013.
Schweinberger, S.R., Kloth, N.,&Jenkins, R.(2007). Are you looking at me? Neuralcorrelates of gaze adaptation. Neuroreport,18(7),693–696.
Senju, A.,&Hasegawa, T.(2005). Direct gaze captures visuospatial attention. Vis.Cogn,12,127-144.
Shibata, T., Nishijo, H., Tamura, R., Miyamoto, K., Eifuku, S., Endo, S., et al.(2002).Generators of visual evoked potentials for faces and eyes in the human brain as determinedby dipole localization. Brain Topogr,15(1),51–63.
Singer, T.(2006). The neuronal basis and ontogeny of empathy and mind reading:Review of literature and implications for future research. Neurosci. Biobehav. Rev,30,855-863.
Smith, M.L., Cottrell, G.W., Gosselin, F.,&Schyns, P.G.(2005). Transmitting anddecoding facial expressions. Psychol. Sci,16(3),184-189.
Smith, N.K., Cacioppo, J.T., Larsen, J.T.,&Chartrand, T.L.(2003). May I have yourattention, please: electrocortical responses to positive and negative stimuli.Neuropsychologia,41,171-183.
Smith, A., Puce, A.,&Allison, T.(2000). ERPs Evoked by viewing facial movements.Cognitive Neuropsychology,17,221-239.
Utama, N.P., Takemoto,A., Koike, Y.,&Nakamura, K.(2009). Phased processing offacial emotion: An ERP study. Neuroscience Research,64,30–40.
Vuilleumier, P.&Pourtois, G.(2007). Distributed and interactive brain mechanismsduring emotion face perception: evidence from functional neuroimaging.Neuropsychologia,45,174-194.
Whalen, P. J., Shin, L. M., McInerney, S. C., Fischer, H., Wright, C.,&Rauch, S. L.(2001). A functional MRI study of human amygdala responses to facial expressions of fearversus anger. Emotion,1(1),70-83.
Whalen, P. J., Kagan, J., Cook, R. G., Davis, F. C., Kim, H., Polis, S., et al.(2004).Human amygdala responsivity to masked fearful eye whites. Science,306(5704),2061.
Wicker, B., Perrett, D. I., Baron-Cohen, S.,&Decety, J.(2003). Being the target ofanother’s emotion: A PET study. Neuropsychologia,41,139-146.
Wild-Wall, N., Dimigen, O.,&Sommer, W.(2008). Interaction of facial expressionsand familiarity: ERP evidence. Biol. Psychol.77(2),138-149.
Williams, L.M., Palmer, D., Lidde ll, B.J., Song, L.,&Gordon, E.(2006). The whenand where of perceiving signals of threat versus non-threat. Neuroimage,31,458-467.
Young, A., Perrett, D., Calder, A., Sprengelmeyer, R.,&Ekman, P.(2002). FacialExpressio ns of Emotion—Stimu li and Tests. Thames Valley Test Company, Bury St. Edmunds, Suffolk, England.